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Abstract  of  Doctoral  Dissertation  Presented  to  the  Graduate 
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The  problem  of  digital  control  of  multivariable  processes 
with  multiple  delays  and  inverse  response  characteristics  is 
addressed.  The  effect  of  the  delays  on  the  parametrization 
of  linear  discrete-time  models  for  multivariable  adaptive 
controller  design  is  studied.  The  inversion  of  multivariable 
plants  for  adaptive  and  internal  model  control  is  addressed 
via  factorization  of  the  process  transfer  matrix.  Finally, 
the  asymptotic  stability  of  multivariable  plants  controlled 
by  self-tuning  controllers  is  investigated. 

Self-tuning  control  algorithms  based  on  the  minimization 
of  a quadratic  performance  measure  are  developed  for  processes 
with  potentially  differing  measurement  and  control  delays. 
Algorithms  with  different  computational  requirements  depending 
upon  the  delay  structure  of  the  process  are  presented.  A me- 
r factorizing  the  process  transfer  matrix  is  given, 
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which  requires  a priori  knowledge  of  only  the  process  delays 
and  which  allows  for  self-tuning  controller  design  in  the 
presence  of  arbitrary  input-output  delays.  The  left  inter- 
actor matrix  is  used  for  determining  the  invertible  part  of 
plants  with  arbitrary  delays  and  no  finite  unstable  zeros. 

The  invertible  part  is  used  in  designing  the  optimal  inter- 
nal model  controller  for  such  processes.  The  right  inter- 
actor matrix  is  introduced  and  used  for  adaptive  controller 
and  feedforward  estimator  design  for  delay  processes.  The 
notion  of  the  generalized  interactors  is  introduced  for 
processes  with  multiple  delays,  multiple  unstable  zeros  and 
non-trivial  cross-couplings.  The  generalized  interactors 
contain  all  the  noninvertible  elements  of  the  process  trans- 
fer matrix  which  are  invariant  under  stable  feedback  control. 
The  left  generalized  interactor  leads  to  the  best  possible 
internal  model  controller  and  in  a dual  way  the  right  gene- 
ralized interactor  leads  to  the  best  possible  feedforward 
disturbance  estimator.  Finally,  the  asymptotic  stability 
of  quadratic  self-tuning  controllers  is  established.  It 
is  shown  that  for  any  initial  state  of  the  plant  and/or 
the  estimator  and  for  suitable  offline  choices  of  the  weights 
in  the  performance  measure,  the  input  and  output  deviations 
tend  to  zero  while  all  system  variables  remain  bounded. 
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CHAPTER  I 
INTRODUCTION 

Process  control  is  used  by  the  chemical  industries  to 
ensure  safe  operation  of  the  plant,  to  suppress  the  influ- 
ence of  external  disturbances,  and  to  optimize  the  plant's 
performance.  Process  control  is  a necessary  part  of  competi- 
tive plants  due  to:  a)  the  increasingly  complex  structure  of 

chemical  processes  due  to  more  efficient  management  of  energy 
and  raw  materials  b)  the  high  and  consistent  quality  speci- 
fications which  the  final  product  should  meet;  and  c)  the 
various  environmental  and  operational  constraints  which  the 
plant  units  must  satisfy. 

Modern  control  theory  now  has  a number  of  valuable  tools 
at  the  disposal  of  the  control  engineer.  Many  of  the  modern 
control  techniques  are  implemented  industrially  by  digital 
computers  and  microprocessors.  The  results  of  this  work  con- 
cern digital  control  and  especially  discrete  adaptive  and  in- 
ternal model  control.  Both  are  particularly  useful  in  chem- 
ical process  applications. 

The  idea  for  a controller  which  could  adapt  itself  auto- 
matically to  changing  characteristics  of  the  controlled  proc- 
ess first  originated  in  aerospace  problems  in  which  classical 
linear  control  performed  unsatisfactorily  due  to  significant 
in-flight  variation  of  the  response  characteristics  of  the 
process  within  the  flight  envelope.  Classical  linear  control 
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is  mainly  based  on  a model  of  the  system  and  its  environment 
obtained  off-line  by  some  system  identification  technique 
from  practical  experiments.  In  the  case  of  a changing  proc- 
ess, at  most  three  controller  parameters  can  be  adjusted  man- 
ually during  operation. 

As  far  as  industrial  plants  are  concerned,  the  complex- 
ity of  the  processes,  the  absence  of  reliable  models,  the 
essential  nonlinearity  of  the  processes,  and  the  often  chang- 
ing operating  conditions  make  self-tuning  control  seem  a prom- 
ising alternative  to  classical  linear  control.  Self-tuning 
controllers  (STCs)  are  discrete  time  adaptive  control  algo- 
rithms. They  were  introduced  by  Astrom  and  Wittenmark  (1)  in 
1973.  Since  then,  the  original  algorithm  has  been  improved 
and  today's  STCs  feature  design  simplicity  together  with  the 
ability  to  handle  open  loop  unstable  or  inverse  response  sys- 
tems. The  part  of  this  work  which  deals  with  adaptive  con- 
trol is  concerned  with  STCs  which  are  performance  oriented, 
i.e.,  the  control  law  is  designed  to  optimize  an  a priori 
chosen  quadratic  performance  index.  Such  algorithms  are  par- 
ticularly useful  in  applications  where  the  system  is  highly 
nonlinear , since  they  are  likely  to  be  more  robust  than  other 
self-tuning  algorithms  (2) . Also,  STCs  based  on  the  minimi- 
zation of  a quadratic  performance  index  which  includes  penal- 
ization of  both  output  and  input  deviations  will  give  im- 
proved economic  performance  of  the  controlled  plant,  espe- 
cially when  the  control  is  not  inexpensive.  Finally,  such 
STCs  can  control  open  loop  unstable  or  inverse  response 
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systems,  provided  that  the  weights  in  the  performance  criterion 
are  suitably  chosen.  This  makes  them  useful  for  digital  con- 
trol since  most  practical  processes,  particularly  when  digi- 
tally controlled,  are  likely  to  exhibit  inverse  response 
characteristics  (3) . Chapters  II,  III,  and  IV  present  multi- 
variable  quadratic  STCs  for  systems  with  multiple  input- 
output  delays.  Chapter  II  is  application  oriented.  The  de- 
sign and  computational  features  of  some  quadratic  STCs  given 
and  the  effect  of  multiple  delays  are  pointed  out.  An  appli- 
cation to  a continuous  stirred  tank  reactor  is  also  given. 

The  part  of  Chapter  III  which  deals  with  STCs  presents  two 
methods  for  transforming  the  original  model  form  to  a form 
suitable  for  quadratic"  STC  design.  Chapter  IV  establishes 
the  stability  of  quadratic  STCs. 

The  Internal  Model  Principle  (IMP)  was  introduced  by 
Francis  and  Wonham  (4)  and  addresses  the  problem  of  tracking 
a desired  output  signal  in  spite  of  the  presence  of  disturb- 
ances, something  very  desirable  in  applications.  According 
to  the  IMP,  in  order  to  achieve  perfect  tracking,  knowledge 
of  the  dynamics  of  both  the  desired  output  signal  and  the 
disturbance  is  required  and  the  modes  of  both  must  be  included 
in  the  controller  design. 

The  Internal  Model  Control  (IMC)  configuration  of  Brosi- 
low  (5)  and  Garcia  and  Morari  (6)  deals  with  the  problem  of 
set  point  tracking  despite  disturbances  in  the  measurement. 

The  IMC  configuration  allows  for  obtaining  the  optimal  con- 
troller, i.e.,  the  one  which  achieves  optimal  output-set- point 
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matching.  It  also  allows  for  an  assessment  of  robustness 
in  case  of  model/plant  mismatch.  Having  the  optimal  feed- 
back controller  for  each  alternative  design  allows  for  op- 
timal plant-controller  design  to  meet  desired  closed  loop 
response  characteristics  (7) . The  IMC  design  requires  the 
plant  to  be  open  loop  stable. 

In  this  work,  the  IMC  design  is  linked  to  some  structural 
characteristics  of  the  plant  which  dictate  the  optimal  way 
that  an  output  signal  can  be  tracked  despite  the  measurement 
disturbances . 

Chapter  III  gives  a method  for  obtaining  the  best  pos- 
sible IMC  controller  for  multivariable  plants  with  multiple 
delays.  The  method  is  based  on  the  interactor  matrix  con- 
cept which  was  introduced  by  Wolowich  and  Falb  (8) . A right 
interactor  matrix  is  introduced  here  and  used  in  adaptive 
controller  design  and  in  the  design  of  an  optimal  feedfor- 
ward disturbance  estimator.  The  generalized  interactor  ma- 
trices introduced  in  Chapter  III  allow  for  optimal  IMC 
controller  and  feedforward  estimator  design  for  multivari- 
able processes  exhibiting  multiple  delays,  multiple  unstable 
zeros,  and  nontrivial  cross-couplings. 


CHAPTER  II 

EFFECT  OF  DELAYS  ON  THE  PARAMETRI Z ATION 
OF  LINEAR  MODELS  FOR  ADAPTIVE  CONTROLLERS 

2 . 1 Introduction 

Self-tuning  controllers  (STCs)  are  adaptive  control 
algorithms  in  which  the  plant  parameters  are  estimated  on- 
line and  consequently  used  in  the  determination  of  the  con- 
trol law.  The  STCs  do  not  require  a detailed  plant  model 
before  start  up  and  can  adapt  to  slow  changes  of  the  proc- 
ess. 

The  control  law  of  a multivariable  STC  can  be  designed 
on  the  basis  of  pole/zero  placement  consideration  (e.g., 
Wellstead  et  al.  (9) , Astrom  and  Wittenmark  (10) , Prager  and 
Wellstead  (11) , Vogel  and  Edgar  (12))  , as  minimum  variance 
(e.g.,  Astrom  and  Wittenmark  (1),  Keviczky  et  al.  (13), 
Borisson  (14),  Goodwin  et  al.  (15),  Bucholt  and  Kummel  (16)) 
or  on  the  basis  of  a more  general  quadratic  performance  meas 
ure  that  penalizes  input  deviation  and/or  input  velocity  in 
addition  to  measurement  deviations.  STCs  of  the  latter  type 
are  particularly  valuable  in  applications  where  control 
energy  is  expensive  or  where  it  is  desired  to  limit  exces- 
sive control  valve  movement.  Several  such  algorithms  have 
been  developed  (e.g.,  Koivo  (17),  Keviczky  and  Kumar  (18), 
Bayoumi  et  al.  (19)),  but  they  all  require  that  inputs  and 
outputs  are  subject  to  the  same  time  delay. 
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However,  in  a plant  there  are  several  control  variables 
and  in  the  general  case  each  one  has  a distinct  time  delay. 
For  example,  in  a reactor  each  one  of  two  possible  control 
variables,  inlet  reactants'  flow  rate  and  inlet  coolant  tem- 
perature, affects  the  process  subject  to  its  own  delay. 
Similarly,  in  a plant  each  one  of  the  measurement  variables 
has  a distinct  delay.  For  instance,  in  the  above  considered 
perfectly  mixed  reactor,  two  measurement  variables  could  be 
outlet  temperature  and  concentration  and  in  general  the  con- 
centration measurement  devices  introduce  greater  delays  than 
the  temperature  measurement  devices  (thermocouples) . Thus, 
each  measurement  variable  is  again  subject  to  a distinct  de- 
lay. The  individual  time  delays  of  measurements  and  con- 
trols are  very  often  encountered  in  practice  and  result  in 
poor  performance  of  conventional  P.I.D.  controllers.  The 
present  chapter  develops  adaptive  STC  algorithms  which  deal 
most  effectively  with  such  cases. 

Multivariable  Self-Tuning 
Controllers  Applicable  to 
Systems  with  Measurements 
of  Differing  Time  Delays 

Discrete  multiple-input  multiple-output  linear  systems 
with  measurements  of  differing  time  delays  are  considered 
here.  By  suitable  manipulations,  the  original  system  model 
is  rewritten  in  three  alternative  forms,  each  of  which  leads 
to  a direct  calculation  of  the  optimal  control  policy.  By 
combining  a recursive  least  squares  parameter  estimator  with 
the  estimated  model  optimal  control  law  for  each  model  form, 
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three  alternative  self-tuning  control  schemes  are  obtained. 
Each  one  uses  a different  amount  of  the  most  recently  ob- 
tained information  and  involves  different  computational  re- 
quirements. Which  one  is  preferable  depends  on  the  number 
of  inputs,  number  of  outputs,  system  order,  and  time  delays 
of  the  process  to  be  controlled,  as  well  as  on  the  capabili- 
ties of  the  available  computer.  All  three  self-tuning  con- 
trol algorithms  are  shown  to  be  successful  in  controlling  a 
continuous-flow  stirred  tank  reactor  model. 

The  Model 

The  process  to  be  controlled  is  assumed  to  be  described 
adequately  by  the  following  linear  model  of  order  n+1: 

A(q_1) z (t+1)  = s+B (q-1) u ( t)  (2-1) 

where  A(q-1),  B(q-1)  are  matrix  polynomials  in  the  backward 
shift  operator  q_1,  i.e.,  q-1y(t)  = y(t-l), 

n 

A(q-1)  = I-q--'-  l A^'q-^ 
i=l 

B(q-1)  = Z B^q-^ 
i=0 

and  where  u(t)  is  the  m-dimensional  control  vector  and  z(t) 
is  the  2,-dimensional  state  vector  at  time  t.  Also  s is  an 
2. -dimensional  parameter  vector;  its  inclusion  allows  the  con- 
sideration of  set  point  changes  and  of  nonzero  mean  load 
changes.  The  states  can  be  measured,  but  the  measurements 
may  be  subject  to  delays.  The  process  parameters  are  the 
unknown  matrices:  s,  A^1^  , B^^  . These  may  change  whenever 

the  process  undergoes  load  or  set  point  changes. 
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Let  yi  denote  the  measurement  of  with  a time  delay 
kj_ . Then, 


Zi(t)  = yi(t+k±)  i=l ,2 ...  a (2-2) 

Without  loss  of  generality,  it  can  be  assumed  that  the  out- 
puts have  been  ordered  so  that 

k-^  ^ ]^2  ...  ^ k^  = k 

Let  " denote  transpose.  Calling 

w'(t)  = [y1(t+k1-k),  y2 (t+k2-k)  , . . . , y£(t)] 
model  (2-1)  is  rewritten  as 

w ( t+k+1)  = s+Aq (q-1)w(t+k)+B(q~1)u(t)  (2-3) 

where 

n 

A0(q  1)  = q [ A ( 0)  -A  (q-1)  ] = E A(l)q-1 

i=l 

If  in  equation  (2-3)  w( t+k-1) , . . . ,w (t+1)  are  substituted 
from  this  same  equation,  the  result  is  the  predictor  of 
w (t+k+1) /t : 

w ( t+k+1)  = s*+C(q-1)w(t)+D(q-1)u(t)  (2-4) 

where 


:*  = 


= R 


k+l£ 


n 


= E 


- C^q"1 
i=0  k+1 


C(q  1) 


(2-5) 
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D (q-1) 


n , • \ 
Z D 1 
i=0  k+1 


and  the  parameters  are  given  by  the  matrix  discrete  convo- 
lution equations : 


R. 


k+1 


k-1  t ■ \ 
1+  E 

j=0 


k-j 


c (i) 

k+l 


„ ■ , k-1  , . 

A(k+i)  + £ a^)c  (i) 

j=0  k"3 


i=0 , 1, 2 , . . .n 


D 


(i)  = 

'k+1 


B^+  E A^D^1  ^ 

j=0  k-j 


i=0 , 1 , . . . n+k 


(2-6) 


Here  a superscript  of  less  than  zero  signifies  a zero  matrix. 
Also  zero  are  A^  and  B^)  for  j > n. 

Model  Form  I 

From  (2-4)  it  follows  that 


Yj(t)  =xr(t-kj-l)  6^  j = l ,2  , I 

where 


(2-7) 


Xj (t-kj-i)  = [1  w' (t-kj-1) . . .w' (t-kj-l-n) 

u' (t-kj-1) . . .u" (t-k^-k-l-n) ] 

0 r = [S*  C(0)...C(n^  D(0)  . . .D(n+k)  ] 

3 3 j j j j J 

where  C ^ , D ^ 

j j 


denote  jth  row. 
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Model  Form  II 

Shifting  of  each  of  the  equations  in  (2-7)  by  kj-k 
yields  the  following  form : 

Yj  (t+kj-k)  = x'(t-k-l)  Oj  j=l,2, . . . ,1  (2-8) 

Model  Form  III 

From  model  (2-1) , we  obtain 

det  A (q-  1)  z ( t+1)  = ad  j (A  (q-1)  ) [ s+B  (q-1)  u ( t)  ] (2-9) 

where  det  stands  for  determinant  and  adj  for  adjoint.  In 
this  form  we  see  that  each  output  depends  merely  on  its  own 
past  values  and  on  the  inputs. 

From  (2-9) , we  get 

w ( t+k+1)  = s**+F(q-1)w(t)+H(q-1)u(t)  (2-10) 

where  s**  is  again  an  £-dimensional  parameter  vector  and 

i , d 

F(q_1)  = diag  [ f i±  (q *  1)  ] ; f i±  (q_1)  = E friicJ~r 

r=0 

i , d+k- 

(H(q-1))ij  = h^lq-l);  h±i  (q'l)  = Z h,  .q~r 

J r=0  J 

d = £ (n+1) -1 

From  equation  (2-10) , it  follows  as  previously: 

y±(t)  = x-;(t-ki-l)  e±  (2-11) 


where 


xi(t-kj-l)  = [1  yi(t-ki-l) . . .yi(t-ki-d-l) 

U' (t-ki-l) . . .U" (t-2ki-d-l) ] 
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and 


= [s** 
1 


.f 


h 


oil*  ' ’ ‘Ldii  “oil*  * *hoim*  * ’n(d+kj_)  il*  * *n(d+ki)  im 


• h , 


Any  of  the  parameter  estimators  given  in  Appendix  A can 
be  used  to  update  the  parameter  vectors  6^  in  (2-7)  , (2-8) 

and  (2-11) , if  the  input  and  output  data  up  to  and  including 
time  t are  available. 

The  Control  Law 

Let  e (t)  = w(t)  -ys 
u(t)  = u(t)-ug 
u(t)  = u(t)-u(t-l) 

where  ys  is  the  set-point  and  ug  is  the  corresponding  steady 
state  control  value.  The  performance  measure  is  chosen  as 

J (u  ( t)  ) = e'  (t+k+l)Qie(t+k+l)  + u'(t)Q2u(t)+2^(t)Q3u(t) 

The  weight  matrix  is  positive  definite  while  Q2  and 
are  positive  semidef inite . The  last  term  enables  penalizing 
sudden  jumps  in  the  control  action.  If  the  input  value  us 
is  unknown,  then  Q2  =0.  If  J(u(t))  is  minimized  with  re- 
spect to  u(t)  and  the  estimated  parameters  are  substituted 
for  the  true  ones  according  to  the  certainty  equivalence 
principle  (Bar-Shalom  and  Tse  (20)) , one  obtains  the  follow- 
ing control  laws. 
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For  model  (2-4)  and  estimation  via  model  forms  (2-7)  or 
(2-8)  : 

(2-12) 

U(t)  = -[D^0)Q1D^0)+Q2+Q3]-l[6i50)Q1a(t)-Q2Us-Q3U(t-l)] 


where  " denotes  transpose  and 


n+k 


a ( t)  = s*+Ct(q  1)w(t)+  Z D(i)u(t-1) 

i=l 


and  where  denotes  estimate  at  time  t.  The  subscript  k+1 
in  the  matrices  was  dropped  for  notational  convenience. 

For  model  (2-10)  and  estimation  via  model  form  (2-11) : 


u(t)  = 


-[H^°)Q1H^0^+Q2+Q3]“1[H^0)Qib(t)_Q2Us_Q3u(t^)|3) 


with 


H(0)  = H (0) 
t r 


and 


b(t) 


S**+F 
t t 


-i  n+k-m 

(q  ±)w(t)+  Z H 1 u ( t-i) 

i=l  1 


The  three  STCs  resulting  from  the  three  model  forms, 

(2-7) , (2-8) , and  (2-11) , and  the  associated  control  laws, 

(2-12) , (2-12) , and  (2-13) , are  called  "standard,"  "simpli- 

fied, and  decoupled,"  respectively.  Some  computational 
characteristics  of  these  are  given  in  Table  2.1.  The  de- 
coupled STC  has  the  advantage  that  it  uses  all  the  recent 
information  available  for  the  control  law  determination 
while  the  other  two  STCs  do  not.  All  three  were  tested  suc- 
cessfully in  the  control  of  a CSTR  reactor.  In  this  appli- 
cation, the  states,  temperature  and  concentration,  were  meas- 
ured with  0 and  4 minutes  time  delay. 


Table  2 . 1 

haracteristics  of  the  "standard," 
simplified,"  and  "decoupled"  STCs. 
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A CSTR  with  Measurement  Delays 

Consider  an  irreversible,  first  order  exothermic  reaction 
carried  out  in  a perfectly  mixed  continuous-flow  stirred  tank 
reactor  (CSTR).  Under  the  assumptions  of  constant  densities, 
negligible  heat  losses,  and  constant  holdup,  the  system  is 
described  by  the  following  equations : 


dcA 

dt 

■ 1 CA0-|  e'E/RT=fl  <2-14, 

dT  . 
dt 

7 CA-v“op  (T-Tc>  <2-15, 

The  notation  and  parameter  values  are  given  below: 


CA  * 

reactant  concentration 

T: 

reactor  temperature 

TC  = 

coolant  temperature 

F: 

flowrate 

V: 

holdup  (1  m3) 

0 

C 

o 

feed  concentration  (8.0  x 103  gmol/m3) 

k : 

Arrhenius  factor  (4.7  x 105  sec-1) 

E: 

activation  energy  (5.0  x 104  J/gmol) 

R: 

gas  constant  (8.31434  J/K-gmol) 

V 

feed  temperature  (300K) 

AH: 

heat  of  reaction  (-2.0  x 104  J/gmol) 

P : 

density  (800  kg/m3) 

Cp  : 

specific  heat  (3.0  x 103  J/kg-K) 

U: 

overall  heat  transfer  coefficient  (1.0  x 103  j/m2* 
sec  *K) 

A: 

heat  transfer  area  (25  m2) 
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Let  the  flowrate  F and  the  coolant  temperature  Tc  be  the 
control  variables.  Furthermore,  let  the  temperature  T be 
measured  with  negligible  time  delay  and  the  reactant  concen- 
tration cA  be  measured  with  a time  delay  of  4 minutes.  These 
measurements  are  not  assumed  noise-free. 

When  implementing  STCs,  it  is  advisable,  for  numerical 
reasons,  that  the  outputs  and  inputs  be  scaled  so  that  they 
are  of  approximately  the  same  order  of  magnitude.  For  this 
reason,  when  applying  the  three  previously  developed  STCs  to 
the  model  of  equations  (2-14)  and  (2-15)  , the  outputs  zq,  z2 
and  the  inputs  uq,  U2  were  taken  to  be 

z = T = Tc 

1 3 00  °K  U1  '3  00  °K 

Z2  S000  gmol/mJ  = 3.10-V3/sec 

A sampling  interval  of  2 minutes  was  chosen.  Thus,  the  time 
delay  parameters  were  kq  = 0,  k2  = 2 and  the  outputs  and  cor- 
responding measurements  were  related  by 

yq(t)  = z1(t)+e1(t)  y2  ( t)  = z2 (t-2) +e2 (t) 

where  e1(t)  and  e2(t)  denote  Gaussian  white  noise  terms.  The 
remaining  a priori  known  algorithm  parameters  were:  n = 0 

(system  is  first  order) , m = 2 (two  control  variables) , and 
i = 2 (two  measurements).  Thus,  from  the  third  column  of 
Table  2.1  it  follows  that  all  three  algorithms  had  the  same 
number  of  parameters,  18.  However,  as  the  last  column  of 
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Table  2.1  indicates,  the  "simplified"  algorithm  required  some- 
what fewer  calculations  than  the  "decoupled." 

The  performance  measure  weight  matrices  used  were 


1 0 

o' 

o 
1 

0.05  0 

o 

I—1 

II 

Q2  = 

Q3  = 

0 10 

— — 

o 

o 

0 0.017 

_ 

The  concentration  deviation  from  the  set  points  (y2—  ^2s^  was 
weighted  10  times  as  much  as  the  temperature  deviation  (yg-yqs) 
because  concentration  is  the  output  of  main  concern.  No  weight 
was  given  to  the  deviation  of  the  inputs  from  their  steady 
state  values  (u-us)  because  these  steady  state  values  (us) 
were  considered  unknown  after  set  point  changes.  Finally,  the 
input  change  (u ( t) -u ( t-1) ) was  weighted  low,  since  large  set 
point  changes  were  to  be  made.  The  coolant  temperature  change 
was  weighted  three  times  the  flowrate  change  because  in  prac- 
tice it  is  harder  to  accomplish  large  changes  in  Tc  than  in  F. 
The  estimation  scheme  RLS-VFF2-MR  given  in  Appendix  A was  used 
for  the  "standard"  and  the  "decoupled"  algorithms.  The  esti- 
mator RLS-VFF2  was  used  for  the  simplified  algorithm. 

The  initial  set  points  were 

Z1  = 1-1  (T  = 330K)  Z2  = 0.15  (85%  conversion) 

At  t = 400  min,  the  concentration  set  point  was  changed  to 

z 2 = 0.20 

while  the  temperature  set  point  was  left  unchanged  (zg  = 1.1). 
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Figures  2-la  to  2-lc  and  2-2a  to  2-2c  show  the  response 
of  the  system  to  "standard"  self-tuning  control.  The  STC  was 
started  at  t = 60  min.  It  was  quite  successful  both  in  regu- 
lation and  in  following  the  set  point  change. 

Even  though  noise  was  not  accounted  for  in  the  develop- 
ment of  the  three  algorithms,  the  STCs  successfully  filter  it 
out.  This  can  be  seen  by  comparing  Figure  2-lb  (Reactor  Tem- 
perature Measurement)  to  Figure  2-lc  (Actual  Reactor  Tempera- 
ture) . 

Figures  2-3a,  2-3b,  2-4a,  and  2-4b  present  the  perform- 
ance of  the  "simplified"  STC.  Very  small  degradation  of  per- 
formance is  observed. 

Finally,  Figures  2-5a,  2-5b,  2-6a,  and  2-6b  present  uq, 
zl,  u2,  and  z2  for  the  "decoupled"  algorithm.  Its  perform- 
ance is  equivalent  to  that  of  the  "standard"  STC. 

Conclusions 

Three  self-tuning  controllers  are  developed  for  systems 
with  measurements  of  differing  time  delays.  The  "decoupled" 
one  utilizes  every  available  piece  of  information  for  both 
the  parameter  updating  and  the  control  policy  determination 
but  may  require  a large  number  of  on-line  calculations  if  the 
number  of  measurements  is  large.  The  "standard"  STC  does  not 
use  part  of  the  most  recent  information  for  the  control  pol- 
icy determination  but,  for  some  systems,  it  may  involve  con- 
siderably fewer  calculations  than  the  "decoupled"  algorithm 
and  in  many  cases  there  is  no  appreciable  deterioration  of 
performance.  By  not  using  some  of  the  most  recently  obtained 
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Figure  2-1.  Response  of  the  "standard"  STC 

(a)  Coolant  temperature  (scaled) 
vs.  time  in  min. 

(b)  Reactor  temperature  measure- 
ment (scaled)  vs.  time  (min). 

(c)  Actual  reactor  temperature 
(scaled)  vs.  time  (min) . 
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Figure  2-2.  Response  of  the  "standard"  STC 

(a)  Flowrate  (scaled)  vs.  time 
(min) . 

(b)  Concentration  measurement 
(scaled)  vs.  time  (min) . 

(c)  Actual  concentration  (scaled) 
vs . time  (min) . 
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Figure  2-3.  Response  of  the  "simplified"  STC 

(a)  Coolant  temperature  (scaled) 
vs.  time  (min) . 

(b)  Actual  reactor  temperature 
(scaled)  vs.  time  (min). 


Figure  2-4.  Response  of  the  "simplified"  STC 

(a)  Flowrate  (scaled)  vs.  time 
(min) . 

(b)  Actual  concentration  (scaled) 
vs . time  (min) . 
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(a) 


(b) 


Figure  2-5.  Response  of  the  "decoupled"  STC 

(a)  Coolant  temperature  (scaled) 
vs.  time  (min). 

(b)  Actual  reactor  temperature 
(scaled)  vs.  time  (min). 
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Figure  2-6.  Response  of  the  "decoupled"  STC 

(a)  Flowrate  (scaled)  vs.  time 
(min) . 

(b)  Actual  concentration  (scaled) 
vs . time  (min) . 
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information  for  the  parameter  updating,  the  "simplified"  al- 
gorithm simplifies  the  "standard"  one  and  reduces  the  amount 
of  on-line  calculation.  This  usually  brings  a small  deteri- 
oration of  performance. 


Adaptive  Controllers  for 
Multivariable  Systems  with 
Measurement  and  Control  Delays 

Self-tuning  controllers  are  developed  for  the  control  of 
multiple-input  multiple-output  discrete  systems  with  measure- 
ments and  controls  of  individual  time  delays,  i.e.,  systems 
in  which  each  measurement  and  each  control  variable  is  sub- 
ject to  a distinct  time  delay.  Two  self-tuning  algorithms 
are  derived,  one  direct  (i.e.,  it  calculates  the  control  pol- 
icy directly  using  the  parameters  given  from  a least  squares 
recursive  parameter  estimator),  and  one  indirect  (e.g.,  it 
does  not  estimate  the  control  policy  parameters  but  calcu- 
lates them  from  model  parameter  estimates  via  recursive  for- 
mulae) . A simulation  example  demonstrates  the  attractive 
properties  of  these  algorithms. 

Model 

The  model  of  order  n+1  has  the  form 


A (q  1)z(t+l)  = s+B  (q-1) 


ui  (t-r1) 

u2 ( t~ r 2 ) 


(2-16) 


Vt-V 


where  is  the  delay  according  to  which  the  ith  input  affects 
the  process.  The  rest  of  the  notation  is  the  same  as  in  (2-1). 
Without  any  loss  of  generality,  it  can  be  assumed  that 
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i=l , 2 , . . .m-1 


Denoting 


w(t)  " = lY1(,t+k1-kz)  , y2(t+k2-kJl)...yji(t)] 


and 


(2-17) 


system  (2-16)  can  be  rewritten  as 


(2-18) 


or 


w(t+d+l)  = s*+C(q  ^)w(t)+D(q  ^)v(t) 


(2-19) 


where  d - k^  + rm  and  the  rest  of  the  notation  is  as  in  (2-4), 
(2-5) , and  (2-6)  for  k = d. 

Equation  (2-19)  leads  to  the  quadratic  performance  meas- 


(2-20) 

J(v(t))  = e (t+d+1)  'Q-^e  (t+d+1) +v  (t)  "Q2v  ( t) +v  (t)  "Q3V  (t) 


e (t)  = w (t)  -ys 
v (t)  = v (t)  — us 
v (t)  = v ( t) -v (t-1) 

Also  Qx,  Q2,  and  Q3  are  weight  matrices.  Minimization  of 
J (v (t) ) with  respect  to  v(t)  and  substitution  of  the  true 
parameters  by  their  estimates  at  time  t gives 


ure 


with 


v (t)  = -(D^0) -q1d^0)+q2+q3] 


(2-21) 

Q1c(t)-Q2us-Q3u(t-1) ] 
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where 

c (t) 


sJ+Ct (q_1 


n+d^ 
)w(t)+  E D 
i=l 


(i) 

t 


v(t-i) 


It  is  noted  that  (rm-r^)  initial  conditions  on  v(t)  are 
needed  in  order  to  determine  u(t)  from  v(t)  since 

u±(t)  = vi(t+ri-rm)  i=l , 2 , . . . ,m 
Parameter  Estimation 

Direct  estimation  of  the  controller  parameters 
Equation  (2-19)  is  written  in  vector  form 

w(t)  = 0x ( t - 1 ) (2-22) 

where 

0 = [s*C^C^  . . .C^D^  . . .D^n+d^  ] 

= 1 1 w' (t-d-1)  . . .w" (t-d-n-1) v' (t-d-1)  . . .v' (t-2d-n-l) ] 

The  rows  of  9 can  then  be  estimated  by  any  of  the  sequential 
algorithms  of  Appendix  A. 

Indirect  estimation  of  the  controller  parameters 
Equation  (2-16)  is  written  as 

w ( t ) = Qx  ( t — 1 ) 
where 

0 = [s  A ^ . . . A B (°)  . . .b  ^ ] 

x(t-l)  = [1  w' (t-1) .. .w' (t-n)v' (t-d-1) .. .v' (t-d-n-1) ] 

The  parameters  in  0 are  estimated  as  before.  After  e (t)  is 
obtained  at  each  sampling  period,  the  controller  parameters 
in  (2-21)  are  calculated  from  equation  (2-6)  for  k = kj,+rm; 
a proof  of  (2-6)  is  given  in  Appendix  C. 
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The  estimation  scheme  of  both  the  direct  and  the  in- 
direct schemes  involves  only  one  gain  vector,  one  covari- 
ance matrix  of  dimensions  [l+£ (n+1) +m(n+l) ]x[l+£ (n+1) +m(n+l) ] , 
and  one  regression  vector  x(t-l). 

The  direct  algorithm  has  the  advantage  over  the  indirect 
that  the  computation  of  the  control  policy  is  considerably 
simpler.  However,  there  is  a trade  off,  namely  that  more 
parameters  need  to  be  estimated.  Also,  the  direct  scheme 
uses  information  obtained  at  time  t-k^-rm— 1 and  previously, 
while  the  indirect  scheme  uses  information  obtained  at  t-1 
(more  recent) . Another  advantage  of  the  indirect  scheme  is 
that  it  requires  less  initialization  time  than  the  direct 


one . 
Example 


The  following  first  order 
system  is  considered: 


ZX  (t+1)* 

S1 

+ 

Z2 (t+1) 

_s2_ 

Y±  ( t)  = zx(t) 
y2(t)  = z2(t-2) 


open  loop  unstable  discrete 


Zj_  (t) 

+ 

1.0 

1 

O 

u> 

1 

(t) 

1 

04 

Nj 

1.5 

o1 

1 — 1 

u2 (t-1) 

Here  n-0,  £ = m = 2,  k-^  = 0,  ^2  = 2,  r^  = 0,  and  r 2 = 1 . 
The  vector  s was  held  at  (0,0)  until  the  sampling  time  t = 
200,  when  it  was  changed  to  (1,1) ^ . The  algorithms  were 
initialized  at  the  same  initialization  time  t^ . The  estima- 
tion algorithm  RLS-VFF2  from  Appendix  A was  used.  The  off- 
line choices  were: 
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Q 


1 


and 


1 0 

0 0 

0.1  0 

' Q2  “ 

o 

II 

— 1 
o 

0 0 

0 0.1 

Ni  - 1.0  Vin  = 0-1  for  the  indirect 
N1  = 1-0  Vin  = 0*7  for  the  direct 


(The  larger  number  of  parameters  in  the  direct  estimation  re- 
quired a higher  bound  to  the  maximum  forgetting  factor  A) . 

The  performance  of  the  algorithms  is  shown  in  Figures 
(2-7)  and  (2-8) . It  is  seen  that  both  succeed  quite  well  in 
adjusting  the  control  policy  to  the  new  optimal  value  after 
the  load  change  at  time  t = 200  sampling  interval. 

Conclusions 

tivariable  systems  in  which  each  measurement  and  each 
control  variable  has  an  individual  time  delay  are  frequently 
encountered  in  practice.  The  self-tuning  controllers  devel- 
oped in  this  section  successfully  control  such  systems,  while 
being  conceptually  simple.  The  indirect  algorithm  uses  the 
most  recent  information  available  for  the  parameter  estima- 
tion and  requires  less  initialization  time.  The  direct  al- 
gorithm estimates  a larger  number  of  parameters  but  involves 
less  computation  to  obtain  the  control  policy.  In  the  simu- 
lation example,  both  algorithms  successfully  handled  a large 
load  change.  Their  performances  were  comparable. 
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Figure  2-7.  Performance  of  the  indirect  STC. 
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Figure  2-8 


Performance  of  the  direct  STC 


CHAPTER  III 

MULTIVARIABLE  ADAPTIVE  AND  INTERNAL  MODEL 
CONTROLLER  DESIGN  VIA  FACTORIZATION  METHODS 

3.1  Introduction 

The  design  of  single-input  single-output  (SISO)  adaptive 
controllers  in  which  the  control  law  is  desired  to  be  linear 
with  respect  to  the  estimated  parameters  requires  knowledge 
of  the  scalar  nonzero  leading  input  coefficient  b^) . In  the 
STC  of  Clarke  and  Gawthrop  (21) , one  may  only  need  to  know  a 
priori  tne  sign  of  b^)  but  then  the  off-line  weight  choices 
do  not  correspond  exactly  to  the  performance  measure  in  the 
adaptive  scheme.  The  situation  is  even  more  complicated  in 
the  multivariable  case  where  the  matrix  B(0^,  the  counterpart 
of  b(°),  should  be  nonsingular  (see  (4-11),  (4-12))  and  known 

a priori.  Furthermore,  the  matrix  B(0)  is  obtained  after  ex- 
tracting a delay  part  from  the  matrix  B(q— f) (otherwise  B^^  = 
B(0)  is  in  general  singular)  and  the  invertibility  properties 
of  ® ^ are  therefore  dependent  on  the  way  this  delay  extract- 

ing is  done.  The  delay  extraction  corresponds  in  general  to 
a factorization  of  the  process  transfer  function  and  in  par- 
ticular of  the  polynomial  matrix  B (q  ^ ) . To  be  more  specific 
in  stating  the  previous  results,  we  assume  the  plant  to  be 
linear,  discrete-time,  and  modeled  by  the  state  equations 
x(t+l)  = Fx(t)+Gu(t) 

, % (3-1) 

y(t)  = Hx  ( t ) 


31 


32 


where  u(t)  and  y(t)  are  the  £-dimensional  input  and  output 
deviation  vectors,  respectively,  and  x(t)  is  the  n-dimensional 
state  vector.  The  results  of  this  section  can  also  be 
applied  to  systems  in  which  the  number  of  inputs  exceeds  that 
of  outputs.  System  (3-1)  corresponds  to  an  input-output  de- 
scription of  the  form 

A(z)y(z)  = B (z)  u (z)  (3-2) 

where  A(z)  and  B(z)  are  polynomial  matrices  of  appropriate 
dimensions  in  z and  y(z)  and  u(z)  denote  the  z-transforms  of 

y(t)  and  u(t),  respectively.  B(z)  in  general  has  ijth  entry 
equal  to 


where  dj_j  denotes  the  time  delay  between  the  jth  input  and 
the  ith  output  (for  a strictly  proper  system  d^  > 1)  and  for 


i/j  1,2,..  . , 2, 


bij  (z)  = bij+bJjz  1+-  • • +bi  j 2 Pl^; 

Also  the  ijth  entry  of  A(z)  can  be  assumed  to  be 


bij  * 0 


,1  -1,2  -2 


aij(z)  = l+a^ j z x+a_z  ^...H-a^lz  ij 


Form  (3-2)  corresponds  to  a left  matrix  fraction  description 
(22)  of  (3-1)  , i.e.  , 


y (z)  = G (z)  u (z) 
G(z)  = A ( z ) -1B ( z ) 
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where  G(z)  is  the  system  transfer  function  matrix,  which  is 
assumed  to  be  strictly  proper,  i.e.,  it  satisfies 

lim  G(z)  = 0 

and  of  rank  equal  (23)  to  2,  the  number  of  outputs.  In  the 
case  of  more  inputs  being  available  than  outputs,  one  can 
consider  only  the  inputs  which  correspond  to  any  2,-set  of 
linearly  independent  columns  of  G(z) . This  makes  output  con- 
trollability possible  (24) . 

In  Borisson  (14)  and  Koivo  (17),  it  is  assumed  that  all 
the  delays  dj_j  are  equal  to  k+1.  In  Goodwin  et  al.  (15)  as 
well  as  in  Tsiligiannis  and  Svoronos  (24) , a different  delay 
was  associated  with  each  output.  The  notion  of  the  interactor 
matrix  introduced  by  Wolowich  and  Falb  (8)  was  used  in  Goodwin 
and  Long  (25)  and  in  Elliot  and  Wolowich  (26)  to  extract  the 
delay  part  of  the  transfer  function  in  order  to  obtain  a sys- 
tem parametrization  with  a nonsingular  B^).  jt  turns  out 
that  knowledge  of  the  interactor  matrix  is  equivalent  to  know- 
ing the  Hermite  canonical  form  of  the  process  transfer  func- 
tion, a requirement  which  is  not  in  general  met  by  systems 
which  are  to  be  adaptively  controlled.  The  problem  of  obtain- 
ing a parametrization  of  the  system  with  nonsingular  B^  was 
also  addressed  in  Johansson  (27)  and  (28) , where  the  developed 
parametrizations  were  based  on  the  structure  matrix  concept 
introduced  by  Pernebo  (29)  . However,  a priori  information  is 
needed  by  this  approach  also,  since  knowledge  of  the  structure 


matrix  is  essentially  knowledge  of  the  Smith-McMillan  canon- 
ical form  of  the  system  transfer  function. 

In  what  follows,  first  a delay  factorization  procedure  is 
given  which  leads  to  a parametrization  of  the  model  with  non- 
singular B^0)  and  is  therefore  suitable  for  STC  design.  The 
method  does  not  require  knowledge  of  bj_j  parameters  and  is 
applicable  in  general  to  two-dimensional  systems  and  to  a 
larger  class  of  higher  dimensional  systems  than  those  treated 
in  Goodwin  et  al.  (15)  or  in  Tsiligiannis  and  Svoronos  (24). 
The  latter  correspond  to  the  case  of  a diagonal  interactor 
matrix.  Second,  the  notion  of  system  invariants  is  dis- 
cussed and  the  right  interactor  is  introduced  in  addition  to 
the  existing  (left)  interactor.  The  right  interactor  is 
shown  to  be  a process  invariant  for  disturbance  estimation  in 
the  same  way  as  the  left  interactor  is  an  invariant  under 
feedback  control.  Next  the  left  interactor  is  used  for  de- 
signing  the  best  possible  IMC  controller  in  case  of  delays 
and  no  finite  unstable  zeros  present  in  the  system.  In  a 
'lusl  ^a.y / the  right  interactor  is  used  for  designing  the  per— 
l^ut  disturbance  estimator . This  is  followed  by  an  adaptive 
control  algorithm  design  based  on  the  right  interactor. 
Finally,  the  notions  of  generalized  left  and  right  interactor 
matrices  are  introduced  and  used  for  IMC  controller  and  feed- 
forward estimator  design  for  processes  with  multiple  delays, 
multiple  unstable  zeros,  and  non-trivial  cross-couplings. 
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3.2  Multivariable  STC  Design 
Via  Delay  Factorization 

A procedure  which  leads  to  a factorization  of  the  process 
delays  in  such  a way  that  the  resulting  model  has  a nonsingu- 
lar j_s  given  in  this  section.  Due  to  the  facts  that  the 

polynomial  matrix  A(q-1)  can  always  be  diagonalized  (see  (2-9)) 
and  that  the  process  delays  are  greater  than  or  equal  to  one, 
we  can  assume  the  model  to  be  of  the  form 

A(q_1)y(t+1)  = s+B  ' (q-1)  u ( t) 

A (q-1)  = diag  [aj_  (q-1)  ] (3  4) 


with 


aj.  (q-1)  = 1+a^q"1 


+ai2q  2+. . 


+a 


ia^ 


_ai 


and 

[B^q"1)]  = q-dijbij(q-1)  dij  > 0 


with 


bij<<3_1) 


bij0+bi3 


-1. 
ilq  +> 


. +b  • 


ijbiiq 


5ijO 


^ 0 for  all 


1 ' 3 


Thus,  dj_j  is  the  time  delay  between  control  Uj  and  measure- 
ment  Yi t in  addition  to  the  inherent  delay  of  one  sampling 
interval  present  in  discrete  time  systems.  Let 


det  B^q-1)  = bQq  P+b1q~P~1+ . . . +bp .q"P  P ; bQ  5*  0 

Also  let  d|j^,  i = 1,2,..., A be  a set  of  delays  which  form 
the  leading  exponent  of  det  B (q-1) , i.e.. 


d*  +d* . +. 
Ill  2j2 


. +d*  . 

ijl 


P- 
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It  is  assumed  that  these  d* ^ (and  hence  p)  are  known.  The 
rest  of  the  delays  need  not  be  known  but  knowledge  of  a lower 
bound  d±j  is  required  for  every  delay  d^  . In  addition,  it 
is  assumed  that  upper  bounds  to  the  orders  of  the  polynomial 
matrices  are  known. 

Consider  now  the  following  optimization  problem:  find 

nonnegative  integers  k±  and  r±/  i = 1,2,...,£  which  maximize 

£ 

1 = iiiki+ri ' (3_5) 

subject  to 

ki+rj  < ^ij'  for  i/ j = 1 , 2 ,...,£  . 

This  is  a standard  linear  integer  programming  problem  and  can 
be  easily  solved,  for  example,  by  the  methods  given  in  Kauf- 
mann  and  Labordere  (30) . Then  the  matrices 

K(q)  = diag(qkl)  / 

R(q-1)  = diag(q~ri) 

are  formed  and  then  model  (3-4)  is  equivalent  to  the  model 
A (q_1) K (q) y (t+1)  = S+B (q_1) R (q-1) u ( t)  (3-6) 


(q  3)  = I A^^q 
i=0 

(q_1)  = K(q)B'  (q_1)R(q) 


n 

I 

i=0 


B (l) q_1 


with 
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where  A ^ and  B ^ ^ are  constant  HxZ  matrices  and 


n ^ max  {max(ai~l),  max (d ■ . +b • ■ -k • -r . ) 

i ij  J 13  1 3 

Note  that  model  (3-6)  is  model  (2-18)  with 


w(t+k)  = K(q)y(t);  k = max{k,  } 


X r 


v(t)  = R (q  1)u(t+r);  r = max{r-} 


should  be  pointed  out  that  lumped  parameter  systems  re- 
sult naturally  in  form  (3-6) , in  which  there  is  a delay  k^ 
associated  with  each  measurement  yi  and  a delay  r i associated 
with  each  control  u^.  However,  experimental  determination  of 
the  time  delays  leads  to  form  (3-4) . 

The  following  theorem  establishes  the  equivalence  of 
models  (3-4)  and  (3-6) . 

Theorem  3.1.  Let  B'(q_1)  be  as  in  (3-4)  with 

det(B  (q  ) = bgq  P+h.o.t.,  bg  0 (h.o.t.  denotes  higher 

order  terms  in  q“l) 

Then 

(i)  for  any  set  of  k^ ' s and  r^ ' s which  solve  the  optimization 
problem  (3-5)  the  factorization 

B'(q_1)  = K (q-1)  B R(q-1) 

with 

K(q-1)  = diag(q-ki) 

and 

R(q_1)  = diag(q-ri) 
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has 

B ( 0 ) (=B<°>  = D(0)  ) 

nonsingular  if  and  only  if 
-^max  = P* 

If  5.  = 2 (two  control  and  measured  variables)  , all  so- 
lutions of  (3-5)  result  in  a nonsingular  B(0)  provided 
p = min  (d]_y+d22  ' ^12+^21^  * 

Proof : 

(i)  Given  any  set  ky , r^  such  that 

ki+ri  < d — , all  i,  j 
the  matrix 

B = K (q) B' (q-1) R(q)  (3-7) 

does  not  include  a power  of  q higher  than  zero  and 
therefore  can  be  written  as 

B (q-1)  = I B^q--1. 
i=0 


From 

B'(q-1)  = K (q-1) B (q-1) R(q-1) 
taking  determinants,  it  follows  that 


a 

- E ki+ri 
1=1 

b0q_p+h.o.t.  = q [det  B ( 0 ) +h . o . t . ] (3-8) 

From  (3-8)  it  follows  that 

Z 

p > E hi+ri 
i=l 

and  that 


det  (B  ( 0)  ) jt  0 
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if  and  only  if 

a 

z ki+ri  = P . 
i=l 

(ii)  This  part  is  proved  directly  by  construction.  The  in- 
puts and  outputs  can  be  rearranged  so  that 

dll+d22  ^ d12+d21 

and 

d12  >d21- 
Then  if  (a) 

d21  > dn+d2  2 ' 

a solution  is 

kl  = 0,  k2  = d22,  r1  = dlx,  r2  = 0 
and  if  (b) 

d21  < dll+d22  ' 
a solution  in  case  (b^) 

d21  > d22  ' 
is 

kl  = dll+d22-d21 ' k2  = d22 ' rl  = d21-d22 ’ r2  = 0 
and  a solution  in  case  (b2) 

d21  < d22  / 
is 

= d21 ' rl  = 


kl  “ dll'  k2 


0,  r2  - d22-d2i» 
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Since  all  these  solutions  give 
2 

Z ki+ri  = dll+d22 
i=l 

and 

ki+rj  < dij' 

it  follows  from  the  assumption  on  p,  which  is  gener— 

ically  true,  that  B(0)  is  nonsingular. 

Remark : From  Theorem  3.1,  it  follows  that  all  systems 

satisfying  the  condition  of  Lemma  3.2  for  z = 0 of  Goodwin  et 
al.  (15) , i.e.,  systems  with  diagonal  interactor  matrix,  can 
be  written  in  the  form  (3-6)  with  generically  nonsingular 
B ^ and  with 

ki  = min  di.,  ry  = 0,  i = 1,2,...*. 

j 

Theorem  3.1  states  that  the  matrix  B^  is  nonsingular 
if  and  only  if  Imax  = p,  a condition  easily  checked  once  the 
ki  and  rj_  have  been  determined.  This  condition  will  be  gen- 
erally  true  for  £ = 2,  while  for  i > 2 it  will  be  true  for  a 
larger  class  of  systems  than  those  treated  in  Goodwin  et  al. 
(15) . It  could  also  happen  that  the  integer  programming  prob- 
lem (3-5)  has  multiple  solutions.  In  this  case,  the  solution 
with  minimum  k j , where  y j is  the  most  important  output,  is 
chosen.  Finally,  it  is  noted  that  the  calculation  of  k-j_  and 
ri  is  done  off-line  and  involves  no  unknown  parameters. 

Examples : This  example  treats  a three-dimensional  sys- 

tem with  an  unknown  and  possibly  nondiagonal  interactor  ma- 
trix. Let  the  system  be 


41 


y (t+i) 


bll<r3 

bi2q-5 

bl3q  5 

b2iq-d21 

b22q-2 

b23 

u(t) 

(3-9) 
bij  * o 

_b31^  d31 

b32q_1 

b33q‘d33 

The  unspecified  delays  (d21,  d31,  d33)  are  unknown  nonnegative 
integers.  The  information  available  allows  us  to  set  p = 4. 
Solution  of  the  optimization  problem  (3-5)  using  the  lower 
bound  zero  for  the  unspecified  delays  gives 


kl  = 3/  r2  = 1 

and 

k2  = k3  = ri  = r3  = 0. 


Thus,  (3-9)  can  be  rewritten  in  the  form  of  (3-6) 


as 


n 


w(t+l)  = z B(l^v(t-4-i) 
i=l 


with 


B 


(0) 


blx  0 0 


J23 


x 


532 


x 


where  x denotes  an  element  which  may  or  may  not  be  zero 
Clearly,  since 


bll'  b23 ' b32  ^ 
det  B ¥■  0 . 
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Note  that  if  d-^  or  equal  zero,  the  interactor  matrix 
is  not  diagonal.  This  system  can  be  treated  by  the  STC  pre- 
sented here  even  though  the  interactor  is  not  fully  known. 

The  following  example  constitutes  a case  where  the  al- 
gorithm will  not  result  in  a nonsingular  Let 


B ^ (q-1 ) = 


1 q 


-1  q-1 


1 2q-1  q-1 


1 


1 


1 


Then  p = 1 but  since 


i, j = 1,2,3 


we  must  have 


ki  = ri  = 0 i = 1,2,3. 


3 

Therefore,  i k-j+r-  = 0 < 1 
i=l 


and 


will  be  singular. 


Indeed , 


10  0 


B(°)  = B'  (0)  = 


10  0 


111 


which  is  singular. 

The  next  example  shows  that  the  solution  to  (3-5)  is  not 
necessarily  obtained  by  first  extracting  the  ky ' s as  the  mini- 
mum delays  of  each  row  and  then  extracting  the  ry's. 


Let 
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B'  (q 


Here  p = 


k 


1 


9 • Taking 


1/  k-2  — 1/  k^  — 3, 


we  see  that 


r^  = 0,  r2  = 0 , and  < 1 
But  then 

3 

p = 9 > 6 > Z ki+ri 
i=l 


and  the  resulting  B^  is  singular.  The  same  example  shows 
that  extraction  of  the  r^'s  as  the  minimum  delays  in  each  col- 
umn and  then  extraction  of  k.j_ ' s will  also  result  in  a singu- 
lar B^)  . For,  taking 


rl  = r2  = 3'  r3  = 4, 
we  obtain 


ki  - k2  - k3  = ° 


and 

P 


3 

9 > 8 = £ k^+r^. 

i=l 
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However,  the  solution  of  (3-5) , 

kl  = k2  ~ 1'  k3  = 0,  r]_  = 0,  r2  = 3,  r3  = 4 

results  in  a nonsingular  b(°). 

The  following  key  observation  will  allow  us  to  design  an 
implemen table  control  law  for  the  model  (3-6) . 

Lemma  3.2.  If 

R(q-1)  = diag  q~ri  i = 1,2,..., A 

and 

v ( t ) = qr  R(q_1)u(t) 
where 

r = max{  r } , 
i 

then  u(t)  can  be  determined  if 

v ( t ) , v (t— 1) , . . . v (t— r+m) 

are  known,  where 

m = min{r • } . 
i 

In  other  words,  u(t)  can  be  determined  at  every  t after  an 
initialization  period  of  r-m+1  steps. 

Proof  We  have 

u ( t ) = q-r  R (q) v ( t ) 

which  includes  no  predictive  elements  since  it  is  a polynomial 
matrix  in  q-1.  Moreover,  if 
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then 

Uj  (t)  = v j (t) 

and  all  other  components  of  u(t)  correspond  to 
v(t-l),  v ( t-2)  , . . . , v (t-r+m)  . 

In  particular,  if 


m 


'm 


/ 


then 

= vm( t-r+m)  . 


Note  that  qr  R(q  1)  here  being  stably  invertible  guaran- 
tees that  it  will  have  a causal  inverse  since  it  is  diagonal. 
In  general,  however,  stable  invertibility  does  not  guarantee 
causality  of  the  inverse.  This  is  shown  by 


T(z) 


0 

z 


which  is  stably  invertible  but  which  has  no  causal  inverse 
since 


Based  now  on  model  (3-6) , we  can  design  the  control  law 
which  will  give  v(t)  at  each  sampling  instant.  Denoting  by 
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Y s and  us  the  desired  steady  state  values,  (3-6)  suggests  the 
following  performance  measure  in  parallel  to  (2-16),  (2-17), 
(2-18),  (2-19),  and  (2-20): 

(3-10) 

J(v(t))  = ||  P(q-l)  [w(t+d+l)-ys]  ||2+||  Q'(q-l)  [v(t)-us]  ||  2 
where 

w(t)  = qk  K(q)y(t),  k = max  k±,  and  d = k+r 

i 

and  where  P (q  d) , Q'(q  d)  are  ixZ  matrix  polynomials  in  q-d 
and  P(0)  is  assumed  to  be  nonsingular.  In  industrial  proc- 
esses, us  is  frequently  known  from  steady  state  operation  data. 
In  case  it  is  unknown,  one  chooses  Q^(q~d)  such  that  Q^(l)  = 0. 

Assuming  that  b(°)  is  nonsingular,  (.z  k^+rj,  = p)  , the  op- 
timum controller  sets: 

P (q-1)w(t+d+l)+Q(q-l)  [v(t)  -us]  =P(l)ys  (3-11) 

where 

Q(q-1)  = (PT (0) ) -1 (B T) _1Q't (0) Q' (q_1) . 

The  off-line  choice  for  the  input  weight  is  now  Q(q-1)  in- 
stead of  Q (q  1) . Guidelines  for  choosing  it  are  given  in 
Koivo  (17) . 

The  self-tuning  control  law  is: 

(3-12) 

. n „ . . . n+d 

P (q  ) [s(t)+  z Cu'  (t)  w (t-i)  + I D ^ 1 ^ ( t)  v (t-i)  ] + 

1=0  i=0 

Q(q-1)  [v(t)  -usJ  = P(l)ys 

where  . (t)  denotes  estimate  of  • at  time  t. 


An  analysis  and 
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proof  of  asymptotic  stability  for  this  algorithm  is  given  in 
Chapter  IV. 

3.3  Design  of  Multivariable  Adaptive 
and  Internal  Model  Controllers 
via  System  Invariants 

As  the  theory  for  single-input,  single-output  adaptive  and 
internal  model  control  has  solidified  in  the  last  decade, 
attention  has  turned  toward  extension  of  the  main  principles 
to  multiple-input,  multiple-output  systems.  Issues  such  as 
stability  of  multivariable  systems  under  a certain  feedback 
control  action,  decoupling,  multivariable  time  delay  compen- 
sation, and  disturbance  estimation  in  multivariable  processes 
are  intimately  related  to  the  structure  of  the  process  trans- 
fer matrix.  In  particular,  there  are  some  process  character- 
istics which  include  time  delays  and  inverse  response  behavior 
which  cannot  be  affected  by  any  stable  linear  feedback  con- 
troller and  which  will  therefore  appear  necessarily  in  the 
system's  response.  The  optimal  feedback  controller  allows  for 
a minimal  effect  of  such  characteristics  on  the  output  re- 
sponse. Apart  from  control,  it  can  be  used  for  evaluation  of 
design  alternatives  according  to  their  operability  features. 
The  best  possible  linear  feedback  controller  is  determined 
here  by  use  of  the  left  interactor  and  left  generalized  inter- 
matrices.  Dual  results  are  shown  for  disturbance  esti- 
mation where  the  best  possible  feedforward  estimator  is  found 
by  use  of  the  right  interactors. 

The  process  characteristics  which  make  it  impossible  to 
have  perfect  control,  i.e.,  all  plant  outputs  equal  to  the 
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desired  set  points  for  all  times,  via  stable  controller  are 
pointed  out  next.  Also  the  same  characteristics  are  shown  to 
forbid  perfect  disturbance  estimation  via  a stable  feedfor- 
ward estimator.  If  a left  coprime  factorization  of  C and  a 
right  coprime  factorization  of  G in  Figure  3-1  are  C = Q-1P 
and  G = BA~1,  respectively,  then 

Qu  = -Py+Pys 

and  the  closed  loop  is  described  by 

y = B (PB+QA) _1Pys+B (PB+QA) -lQAB-1d. 

Hence,  any  attempt  to  cancel  the  unstable  zeros  of  B will  in- 
troduce an  unobservable  unstable  mode  in  the  closed  loop 
transfer  function.  Consequently,  under  any  stable  controller, 
the  system  will  respond  to  set  point  changes  according  to  the 
dead  times  and  the  inverse  response  characteristics  of  B. 
Consider  now  the  problem  corresponding  to  Figure  3-2  where  we 
want  an  estimate  d of  the  unmeasurable  disturbance  d which 
affects  the  system  G.  If  G = BA-1  and  E = PQ-1  are  right 
coprime  factorizations  of  G and  E,  then 

d = PQ-1BA-1d 

and  no  stable  and  proper  estimator  E can  cancel  the  time  de- 
lays and  inverse  response  characteristics  of  B. 

Next  the  above  characteristics  are  extracted  from  the 
process  transfer  function  by  use  of  the  interactor  matrices. 

We  start  with  the  interactors  which  characterize  the  delay 
structure  of  the  process. 


d 


Figure  3-1.  The  classical  feedback  control  loop. 
C = controller,  G = plant, 
ys  = set-point,  y = output, 
d = disturbance. 


Figure  3-2.  Feedforward  disturbance  estimator  (E) . 
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Lemma  3.3.  For  any  proper  ixl  transfer  matrix  G(z)  of  rank  l, 
there  exist  two  unique  polynomial  matrices,  a lower  triangular 
one,  5q(z),  and  an  upper  triangular  one,  ?g(z),  called  the  left 
and  right  interactor  matrices,  respectively,  which  are  of  the 
form 

Zq(z)  = H*(z)  diag[zkl,  . . . ,zk*] 

£g(z)  = diag[zrl,  . . . ,zr£]  h£(z) 

HG(0)  = Hg(0)  = 1 (HG(z)ii  = (HG(2))ii  = 1 

Hq(z)  is  a lower  triangular  polynomial  matrix,  H (z)  is 

G 

an  upper  triangular  polynomial  matrix 

and  which  have  the  following  properties: 

(i)  lim  £„(z)  G(z)  = with  nonsingular; 

lim  G(z)  C^(z)  = with  nonsingular; 

Z->co  O G G 

(ii)  Both  5q(z)  and  5q(z)  are  stably  invertible; 

(iii)  Both  Cq(z)  and  £^(z)  are  causally  invertible. 

Proof : 

(i)  The  left  interactor  was  introduced  in  Wolowich  and  Falb 
(8).  Let  " denote  transpose.  It  follows  that  for  G' (z) 
there  exists  Zq'(z)  such  that 

lim  G'(z)  = Kp  ^ nonsingular 

z-*o  G G G 


lim  G(z) 
Z-x» 


nonsingular, 

G G 


or 
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Thus 


s 


l 

Ik, 


(ii)  det  5q(z)  = z 


_ „i=l 


= t i 


7^  0 for  I z I ^ 1 , 


£ 

•-  ri 

det  £q(z)  = z1_1  ^ 0 for  |z|  > 1,  QED. 


( iii)  Let  £*(z)  G(z)  = K*(z).  Then 


lim  ?p(z)-1  = lim  G(z)  K^(z)  1 = G(°°)  K^:-1 


Z->oo 


Z->co 


which  is  finite  since  G is  strictly  proper  and  is 

G 

nonsingular.  Then  ^ is  strictly  proper,  or  is 
causally  invertible. 

Lemma  3 . 4.  Let  G(z)  be  as  in  Lemma  3.3.  Then  G(z)-^-  ^^(z)-^ 

G 

and  5g(z)-^-  G.(z)~l  are  proper. 

Proof : We  have  that 


lim  G ( z ) -1  ^(z)  1 = 

Z^co  G G 

and 

lim  C^(z)"1  G ( z ) -1  = K^_1 

Z-*x>  G G 

and  both  K^-1  and  K^-1  are  finite  since  K*  and  are  non- 
G G G 

singular . 

Theorem  3.5.  Let  G-^(z)  , G^(z)  be  as  in  Lemma  3.1.  Then  there 
exists  a proper  G(z)  such  that 


(i) 

G1(z)  G ( z ) = G2(z) 

if 

and  only 

if 

?Gi^z^  ?G2  ^ 1 

is  proper 

(ii) 

G ( z ) G1(z)  = G2(z) 

if 

and  only 

if 

5G2<Z>_1  ^(z) 

is  proper. 
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Proof:  The  proof  for  (ii)  given  here  is  analogous  to  the  one 

for  (i)  given  in  (8) . 

G(z)  = G2(z)  G'^z)  = 

G2  5G2(z)  (2)_1  ?gx(z))  ( ( z ) _1  G1(z)-1) 

which  by  Lemma  3.4  shows  (ii) . 

Application  of  Theorem  3.5  for  G2(z)  = I gives 
Corollary  3.6.  If  Gg(z)  is  proper,  then 

(i)  G1(z)  has  a proper  right  inverse  if  and  only  if  Cq^z)  = I 
(ii)  Gp  (z)  has  a proper  left  inverse  if  and  only  if  (Z)  = I. 
The  proof  is  a direct  consequence  of  the  fact  that 

Sj(z)  = 5j(z)  = I. 

Internal  Model  Controller  Design  via  the  Left  Interactor 
ihe  above  results  are  used  here  in  designing  internal 
model  controllers  for  systems  with  multiple  delays.  The  argu- 
ment (z)  and  the  - are  dropped  in  what  follows  for  notational 
simplicity. 

The  standard  feedback  controller  structure  of  Figure  3-1 
which  corresponds  to 

y = G (I+CG) -1C (ys-d) +d 

u = (I+CG) _1C(ys-d) 

is  equivalent  (31)  to  the  internal  model  control  structure 
shown  in  Figure  3-3,  with 
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Figure  3-3.  The  internal  model  control 
configuration. 
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Gc  = C (I+GC) -1 
C = GC(I-GGC)_1 

where  G is  an  assumed  plant  model.  The  closed  loop  behavior 
is  described  then  by 

y = GG^ (1+ (G-G) G^) (ys-d) +d 

*\j  ' 

from  which  if  G is  stably  invertible,  i.e.,  if  det  G(z)  ± 0 
for  all  complex  z with  |z|  > 1,  then  the  choice  Gc  = G--  will 
yield  (6)  the  best  possible  output  response.  However,  due  to 
the  presence  of  unstable  zeros  including  the  ones  at  infinity 
which  are  due  to  the  presence  of  time  delays,  G is  never 
stably  invertible,  for  discrete-time  systems.  This  is  justi- 
fied since  G(z)  is  strictly  proper,  due  to  the  inherent  time 

delay  of  one  sampling  interval.  Then  it  can  be  seen  by  the 

£ 

construction  of  in  Appendix  B that  kj_  > 0,  i = 1,2,...,£. 

£ 

Consequently,  is  never  equal  to  I and  by  corollary  3.6, 

% 

G(z)  does  not  have  a proper  right  inverse. 

In  i_he  following , the  necessary  stability  condition  for 
internal  model  controller  design,  i.e.,  that  the  system  is 
open  loop  stable,  is  made.  Also  it  is  assumed  that  G has  no 
finite  unstable  zeros,  an  assumption  that  will  be  relaxed 
later . 

The  delay  structure  of  the  process  is  taken  care  of  in 
the  IM  controller  design  by: 

Theorem  3.7.  (Characterization  of  all  admissible  controllers) . 
Assume  that  a linear  system  with  transfer  matrix  G(z)  is  open 
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loop  stable  and  has  all  finite  transmission  zeros  inside  the 
unit  circle.  Then  for  any  proper  and  stable  (no  poles  on  or 
outside  the  unit  circle)  transfer  matrix  T with  T(l)  = I, 
the  IM  controller 

Gc(z)  = G(z)_1  ^(z)"1  5q(1)T(z) 

is  proper  and  stable  and  eliminates  steady  state  offset.  It 
is  noted  that  T will  in  general  contain  the  IM  filter  which 
enhances  the  robustness  of  the  closed  loop. 

Proof : From  Lemma  3.4,  is  proper.  It  will  be  shown  that 

Gc  is  also  stable.  Since  Kq  is  stably  invertible  (Lemma  3.3 
(ii) ) , G has  no  finite  unstable  zeros,  and  T is  stable,  Gc  is 
also  stable.  Finally,  since  the  closed  loop  transfer  function 
at  z = 1 is  equal  to  I,  Gc(z)  eliminates  steady  state  offset. 
Theorem  3.8.  (Design  of  optimal  IM  controllers) . Assume  that 
the  plant  G(z)  has  no  finite  zeros  on  or  outside  the  unit 
circle . 

(i)  For  step  changes  in  the  set-point  vector,  the  IM  control- 
ler 

Gc(z)  = G(z)-1  ^(z)"1  5^(1)  (3-13) 

minimizes  t , t2,...,t£  where  t^  is  the  time  so  that  for 
t > t,  y^(t)  = ysl,  and  in  general  t^  is  the  time  so  that 
for  t > t±,  yi(t)  = ysi,  provided  that  t±r  t2,...,t£_1  are 
minimized.  In  other  words,  output  yi  reaches  its  set-point 
as  soon  as  possible  without  adversely  affecting  a lower  in- 
dexed output. 
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(ii)  If  (?q(z) ) i±  = zki,  then 

t£  = t.*.+ki;  i = 1,2, ...  ,a 


(3-14) 


where  t*  is  the  time  at  which  the  set-point  change 
occurred . 

(iii)  If  is  diagonal,  the  IM  controller  (3-13)  is  optimal 
with  respect  to  any  sum  squared  error  (SSE)  or  sum  absolute 


error  (SAE)  criterion  for  step  changes  in  the  set-point  vector. 


Furthermore,  it  provides  complete  decoupling. 

(iv)  The  IM  controller  (3-13)  minimizes  the  SSE: 

w^-1  0 ...  0 0 

0 w£~2.  ..00 


l e " (t)  lim 
t=t  w-**= 


e ( t ) 


0 0 . . . w 0 

0 0 ...01 


with  e = ys-y 

or  the  analogous  SAE. 

Proof : 


(i)  Clearly,  the  performance  index  dictates  that  if  yi  is 
at  its  set-point,  it  must  not  be  moved  by  a set— point  change 
in  yj  for  j > i.  This  directly  implies  that  the  optimal 
closed  loop  transfer  matrix  Gql(z)  must  be  lower  triangular. 
Now  let  t*+r^;  i = !,...,£  be  the  minimal  tj_ . The  definition 
of  tj_  and  the  above  analysis  imply  that  GCL(z)  must  have  the 


form 
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M(z)  - (Gcl(z))_1  = L(z)  diag(zmii  aii(z  ^ ) (3-15) 

b . . (z  - ■*") 

where  L(z)  is  a lower  triangular  matrix  with  diagonal  elements 
1 - and  a^  ( z ),  b^Cz--1)  are  polynomials  in  z_1  with  ai-(0)  and 
^ii  ( 0 ) dii  j.erent  than  zero.  The  controller  that  gives  closed- 
loop  transfer  matrix  G (z)  is 

L-1_j 

Gc(z)  - G(z)_1  Gcl(z)  = (M  ( z ) G(z))_1 


Since  this  must  be  proper  and  since  (£*  (z)G  (z). ) is  so,  so  must 

be  their  product  ^ ( z ) M (z ) _1 . Then  from  (3-15)  follows  that 
>-£  . -1 

£q(z)M(z)  is  lower  triangular  with  diagonal  elements 


(GCL(z))ii  = z mii  ^ii(z  X) 


a.  . (z  1) 

li  ' 


m . . > k . 

ii  l 


which  implies  that  a step  change  in  has  minimum  delay 


and  therefore 


t ■ > t.+k,  ; 


, v i=*J9  0 

± 1 / ^ r • • • r ~ 


(3-16) 


The  IM  controller  (3-13)  gives  closed  loop  transfer  matrix 


Gcl(z)  = C*(l)  = 


z'Kl 


0 


a^  (z)  z ^2  z ^2 


a £ 1 ( 2 ) 2 k£  a£2  (z)  z ' 


. . 0 

. . 0 


. z k£ 
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where  aj^(z)  are  polynomials  in  z with  a|_.  (1)  = 0.  From  the  abo- 
ve equation  it  follows  that  for  every  possible  set-point  change 
at  t* 


Yi = Ysi  ; i = 1,2, . . . ,£ 

and  thus  (3-13)  is  the  optimal  controller. 

(ii)  From  the  argument  above  it  follows  immediately  that  the 

minimal  times  t.  are  equal  to  t.+k  . 

l * i 

(iii)  Let  the  ij  element  of  the  plant  transfer  matrix  be 

b -k 

Z bijkz 

(G(z)).  = z_dij  ^ 

f -k 

2 aijkz 
k=0 

and  let  d^  = min(d^j).  It  is  clearly  impossible  to  influence 
output  y^  before  time  t*+d^ . But  if  the  interactor  is  diago- 
nal,  k^  = d^  and  from  part  (ii)  of  the  theorem,  it  follows 
that 

Y ■ (t)  = y.  (or  e.  (t)  = ) for  t » t.+k. 

1 IS  1 x 1 

The  decoupling  property  follows  immediately  from  the  fact 
that 


Gcl(z)  = ^(z)-1  i+U> 


(iv)  The  criterion  requires  that  J = Z e!T  (t)  must  be 

-L  t=t  1 

minimized;  if  this  minimum  is  zero  (in  which  case  y,  = 0, 

J Is 

CO 

2 

i . e . , no  set-point  change  m y took  place)  J„  = Z e_ (t) 

1 t=t* 
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must  be  minimized  (while  maintaining  ej_(t)  = 0);  if  both  min- 
ima are  zero,  in  which  case  yls  = y2s  = 0,  J-,  = T e2  (t) 

...  t=t*  3 

must  be  minimized  (while  maintaining  e-j_(t)  = e0(t)  = 0),  and 

so  on . 

Clearly,  a set-point  change  in  y±  should  not  affect  an 

output  with  a lower  index  and  thus  the  optimal  closed  loop 

transfer  matrix  is  lower  triangular.  From  (i)  we  have  that 

for  a lower  triangular  GCL  the  minimum  delay  at  each  diagonal 

element  is  . Controller  (3-13)  sets  yi(t)  = yis  for  t > 

t*+ki.  Clearly,  this  minimizes  J-,_ . if  the  resulting  ex  (t)  = 

0 for  all  t , in  which  case  ygs  = 0,  e2(t)  depends  only  on  the 

second  diagonal  element  of  Gql  and,  since  (3-13)  gives  e2  = 0 

at  the  first  time  it  can  be  influenced,  we  conclude  that  (3-13) 

minimizes  J2.  Similarly,  one  proves  that  if  min  j-  =0,  con- 

i<j 

i-r°Her  (3-13)  minimizes  Jj  . This  completes  the  proof. 

Theorem  3.8  (ii)  provides  a useful  and  convenient  way  to 
determine  whether  the  optimal  closed  loop  transfer  matrix  can 
be  diagonal.  In  particular,  the  necessary  and  sufficient  con- 
dition is  det  [ ( diag  z -*-)G(z)]  ^ 0 for  z = °°  where  d ^ = min  d^  j 
Theorem  3.9.  (Characterization  of  all  closed  loop  transfer 
matrices.)  Suppose  that  the  closed  loop  transfer  matrix  is 
desired  to  be  of  the  form  G^(z) . Then  there  exists  a stable 
internal  model  controller  which  will  achieve  this  if  and  only 
if  5G  ?Gd_1  is  Proper. 

Proof:  The  proof  follows  directly  from  Theorem  3.5. 

An. example  is  given  next.  Let 
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G (z)  = 


1-0.5  z"1 


2z  3 z-3 

r,~2  -3 


We  have  dx  = 3 , d2  = 2 and 


det 


G (z ) ->  0 as  z-*°°  . 


Therefore,  any  decoupled  closed  loop  response  is  not  optimal. 
By  the  constructive  procedure  in  Appendix  B,  we  find  that 


S‘(z)  = 


-K 


Indeed,  lim  ?q(z)G(z)  = 


, which  is  nonsingular, 


the  internal  model  controller  given  by  Theorem  3.8  as 


Then 


Gc(z) 


1 

“2 


1 


will  give  the  closed  loop  transfer  function 


GCL(Z>  = 


.-3 


|(z'2-z  3) 


-3 


which  is  optimal. 


Assume  now  that  a decoupled  closed  loop  response  is  de- 
sired, i.e.,  G^(z)  = diag[z  ^1  z Then  the  best  possible 

proper  internal  model  controller,  i.e. , the  one  leading  to  the 
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smallest  possible  p-]_,  p^ , can  be  determined  by  Theorem  3.9. 

For  the  previous  example, 

3-p-i 

z 0 

-lz4-Pl  z3-P2 

must  be  proper,  i.e.,  pd  > 4 and  P2  > 3 . Then  the  optimal 
GC  corresponds  to  p-^  = 4,  P2  = 3 and  is  given  by 

-1  -2 
z x -z 

-1  2 

It  is  clear  that  this  can  be  generalized  to 
Theorem  3.10.  If  a diagonal  closed  loop  transfer  matrix  is  de- 
sired, i.e.,  Gs  = diag  (z_Pl),  then  the  smallest  possible  p± , 
i - 1,2  ,...,£  are  given  by  p^  = sc -|_(5q)  = ith  column  degree 
of  E,q.  The  column  degrees  of  the  left  interactor  will  be  the 
smallest  possible  deadtimes  for  a diagonal  Gd.  Any  Gd  with  a 
smaller  pd  will  require  an  improper  Gc. 

Disturbance  Estimation  via  the  Right  Interactor 

Consider  again  the  configuration  of  Figure  (3-2) . Then 
in  a similar  way  to  Theorem  3.8  we  have 
Theorem  3.11.  The  best  possible  E is  given  by 

E(z)  = cgd)  S^U)"1  G(z)_1 

where  is  the  right  interactor  and  G has  no  finite  unstable 
zeros . 

Theorem  3.11  states  that  only  the  part  d of  the  dis- 

G 

turbance  d is  available  for  further  use,  e.g.,  for 
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incorporation  in  the  control  law  for  disturbance  rejection. 

All  admissible  estimators  are  given  by 

r-1  -1 

T G x 

where  T is  stable  and  proper. 

Adaptive  Controller  Design  via  the  Right  Interactor 
Lemma  3.12.  For  any  strictly  proper  transfer  function  G(z), 
there  exist  left  coprime  polynomial  matrices  A"  (z)  , B'(z)  such 
that 

(i)  G (z)  Z^(z)  - A>(z)-1B'(z) 
where  A'(z)  is  row  reduced  (22). 

(ii)  If  ay  denotes  the  ith  row  degree  of  A" (z)  and  by  denotes 
the  ith  row  degree  of  B'(z),  then  ay  = by  and  B'(z)  is  row 
reduced . 

Proof : 

(i)  See  (22)  , (23)  . 

(ii)  Let  A^,  B^  denote  the  matrices  with  elements  at  each  row 
equal  to  the  coefficients  of  the  terms  zai,  zbi  in  A'(z), 
B'(z),  respectively.  We  then  have 


det (G ( z ) 5*(z)) 


det  B"  (z)  _ det  Bpzb+  l.o.t. 

det  A (z)  A za+  l.o.t. 

o 


Z £ 

where  a = I a • , b = E b' , and  l.o.t.  stands  for  lower  order 
i=l  i=l 

terms.  Now  since  G(z)  5q(z)  is  proper  and  A'(z)  is  row  re- 
duced from  (22)  a • > b-.  Then  lim  det(G(z)  C^(z))  = 
det  is  nonsingular  if  and  only  if  a = b (i.e., 

ai  = by,  i = 1,2,...  ,2.)  and  det  Bq  ^ 0.  Q.E.D. 
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Theorem  3.13.  Let  G(z)  be  strictly  proper  and  d = maximum  de- 
gree in  any  element  of  Cq(z)  and  m = minimum  degree  in  any 
element  of  ( z)  . Also  let  v(z)  = z^  £q(z)~^u(z).  Then 
(i)  If  v(t)  is  determined  at  t,  u(t)  can  be  determined  from 
v (t)  after  an  initialization  time  of  d-m  sampling  intervals, 
(ii)  There  exist  polynomial  matrices  ACq--'-),  B(q-1)  in  the 
backward  shift  operator  q-1  such  that 

A(q-1)y(t+d)  = B(q_1)v(t)  (3-17) 

with  A(0)  = I and  B(0)  nonsingular. 

Proof : 

(i)  We  have  that 

u(t)  = q-d  5g(q)v(t) 

and  thus  u(t)  contains  components  of  v(t),  v(t-l) , . . . ,v (t+m-d) . 
The  latter  are  all  available  after  d-m  initial  steps.  Finally, 

a „ 

the  fact  that  q Cgtq)  is  causal  allows  for  determination  of 
u(t)  at  time  t. 

(ii)  Let 

T ( z ) = diag(zai) 

Then  (3-17)  follows  with 

A (q-1)  = (T(q)A')_1  A ' (q) 

B(q-1)  = (T  (q)  A^)  _1  B'  (q) 

Now  that  B ( 0 ) is  nonsingular,  an  adaptive  controller  can 
be  designed  as  in  section  (3.2).  Model  (3-17)  is  written  in 
the  predictor  form 
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y(t+d)  = C(q-1)y(t)+D(q  1)v(t) 

The  control  law  based  on  the  minimization  of  the  performance 
index 


J - ||  P ( q b ) e ( t+d  ) 1 1 2 + 1 1 Q " ( q 1 ) v ( t ) 1 1 2 

where  e(t)  = y(t)-ys,  ys  is  the  set  point,  v(t)  = v(t)-us,  and 
us  is  the  steady  state  control  corresponding  to  ys , will  give 
the  control  policy 

(3-18) 

Ptq-1)  (C(q-1)y(t)+D(q'1)v(t)  )+Q(q_1)v(t)  = P(l)ys 

where  ~ denotes  estimate  at  time  t.  Assuming  that  g£(z)  is 
known,  the  v(t)  given  by  (3-18)  will  give  u(t)  by  Theorem  3.13 
(i) . It  is  noted  that  a similar  theorem  was  given  in  Goodwin 
and  Long  (25)  via  the  $£(z).  The  following  points  out  the 
usefulness  of  Theorem  3.13  and  the  above  suggested  algorithm. 
Knowledge  of  a non-diagonal  left  interactor  matrix  requires 
knowledge  of  some  of  the  systems  parameters.  For  a large  class 
of  systems  with  a non-diagonal  left  interactor  the  right  in- 
teractor is  either  diagonal  or  requires  knowledge  of  fewer 
system  parameters.  It  is  therefore  more  suitable  for  adaptive 
controller  design.  For  instance,  consider  the  strictly  proper 
transfer  function 


G(z) 


b2z  5 
b4z-4 


blb2b3b4  ^ 0 


for  which  it  is  found  readily  that 
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Design  of  an  adaptive  controller  as  in  Goodwin  and  Long  (25) 
requires  knowledge  of  bg/bg.  This  is  not  required  for  con- 
troller design  via  the  ?£(z).  it  is  finally  noted  that  no 
diagonal  form  of  A(q-1)  is  required  here  as  in  Goodwin  et  al. 
(15)  or  as  in  the  adaptive  controller  suggested  in  section 
3.2  and,  therefore,  redundant  parametrizations  are  avoided. 
Generalized  Interactors 

The  following  theory  is  a generalization  of  the  results 
in  the  previous  sections  and  allows  for  determination  of  the 
invariant  process  characteristics  which  are  associated  with 
the  finite-unstable-zeros  structure  of  the  system. 

Lemma  3.14.  Let  s,  | s | ^ 1 be  an  unstable  zero  of  the  transfer 
function  G(z)  and  assume  that  G(z)  is  full  rank  and  proper  at 
s,  i.e.,  lim  G(z)  < Then  there  exists  a unique  lower  tri- 

angular rational  polynomial  matrix  ^Qrs(z)  and  a unique  upper 
triangular  rational  polynomial  matrix  (z)  of  the  form 


66 


3 G f s 


(z)  = H 


G , s 


(ilS2)diag[(lzsz.)  ki] 


z-s 


z-s 


5is<z>  = dia9  l <WrriiHG,s(z> 

(HG,s<z>>ii  = <HG,s<z»>ii  = 1 

with  HG^s (z)  lower  triangular,  s(z)  upper  triangular,  and 

Z IT 

hi  ■ (z)  , h.  . (z)  both  multiples  of  .^~.sz  or  zero,  which  are  called 
J J z-s 

left  and  right  s-interactors  of  G(z)  and  which  have  the  follow- 
ing properties 


(i) 


lim 

z->-s 


5g,s<z>  g<z> 


nonsingular 


lim  G(z) 
z->s 


nonsingular 


(ii)  5q^s(z)  and  5q^s(z)  are  both  stably  invertible. 

Proof:  Let  z = and  apply  Lemma  3.3  for  G"(w)(=  g(1±JL^)). 

s+w  w+s 

Note  also  that  the  s-interactors  can  be  constructed  as  in 

Appendix  B in  the  w domain  and  then  transformed  to  the  z- 

domain  by  w = — Ls.z  . 

z-s 

Remark : If  |s|  =1,  then  instead  of  _sgz  in  the  above  Lemma, 

we  will  have  j:.7.(s+£)  2 — ^~5  . where  | e|  is  small.  This  modi- 

z-s  l-(s+e) 

fication  is  necessary  in  order  for  the  s interactor  to  be 
stably  invertible  without  pole-zero  cancellations  on  the  unit 
circle . 

Similarly,  one  can  show 

Lemma  3.15.  If  G(z)  is  s-proper,  then  G(z)-1  ^ (z)-J-  and 

5g/S(z)  1 G(z)~l  are  s-proper. 
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Theorem  3.16.  Let  Gg(z),  G2(z)  be  s-proper.  Then  there 
exists  an  s-proper  G(z)  such  that 

(i)  Gx(z)  G (z)  = G2(z)  if  and  only  if  5&1#s(z)  Cg2,s(z)_1  is 
s-proper  and 

(n)  G (z)  G1(z)  = G2(z)  if  and  only  if  Sq2  , s ( z ) -1  s(z)  is 

s-proper . 

Corollary  3.17.  If  G^(z)  is  s-proper,  then 

(i)  G-j_(z)  has  an  s-proper  right  inverse  if  and  only  if 

£ 

5gx,s  = 1 and 

(ii)  G-^(z)  has  an  s-proper  left  inverse  if  and  only  if 

5g1/S(z)  = i* 

Next,  define  S to  be  the  set  of  all  unstable  zeros  of 
G(z),  both  finite  and  at  infinity,  (time  delays),  i.e., 

^ — ^ si/i  = 1,2,...,n},  s^  = oo.  Also  define  the  generalized 
left  interactor  to  be 

-o  N 

5£(z)  = " £.(z) 

i=l 

where  Kq(z)  = G(z),  K^(z)  = 5 j_  ( z)  Kj__p  (z),  and  £^(z)  is  the  left 
s^-interactor  of  Ki_1(z). 

Theorem  3.18.  The  rational  matrix  iG(z)  is  an  S-interactor 
of  G (z)  . 

Proof : Let  belong  to  S.  Then 

lim  IG(z)  G ( z ) = lim  (CN  (z)  (z)  ) (g.  (z)  K • ->  ( z ) ) 

z->sn-  z^-s-i  1 x 


which  is  nonsingular  since  both 
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llm  UN(  z)  •••5i+1-(z))  and  lim  U.(z)  Ki_1(.z))  are  so. 

Z'>Si  Z^Sj_ 

Similarly,  one  can  show  the  corresponding  theorem  to  Theorem 
3.18  for  the  right  generalized  interactor  and  then  Lemma  3.4, 
Theorem  3.5,  and  Corollary  3.6  are  generalized  to 
Lemma  3.19.  If  G(z)  is  S-proper,  then  G(z)-1  f,£(z)-1  and 
Sq(z)  ^ G(z)-^  are  S-proper. 

Theorem  3.20.  Let  Gj_(z),  G2(z)  be  S-proper.  Then  there 
exists  an  S-proper  G(z)  such  that 

(i)  G1(z)  G ( z)  = G2(z)  if  and  only  if  5*  (z)  Iq  (z)-1  is  S- 
proper . 

(n)  G ( z ) G1(z)  = G2(z)  if  and  only  if  H (z)_1  \Tr  (z)  is  S- 

G2  g1 

proper . 

Corollary  3.21.  if  G-^(z)  is  S-proper,  then 
(l)  G1(z)  has  an  S-proper  right  inverse  if  and  only  if 
£q(z)  = I and 

(ii)  G-^(z)  has  an  S-proper  left  inverse  if  and  only  if 
?G(Z)  = 

The  above  results  can  be  used  in  the  design  of  internal 
model  controllers  for  open  loop  stable  systems  with  multiple 
delays  and  unstable  zeros.  In  particular.  Theorems  3.7,  3.8, 
3.9,  and  3.10  are  generalized  as  follows. 

Theorem  3.22.  (Generalization  of  Theorem  3.7).  Let  G(z)  be 
a stable  transfer  matrix.  Then  for  any  proper  and  stable 
transfer  matrix  T with  T(l)  = I the  IM  controller 

Gc(z)  = G (z)  -1  c£(z)-1  5^(1)  T ( z ) 
is  both  proper  and  stable  and  eliminates  steady  state  offset. 
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Theorem  3.2j>  (Generalization  of  Theorem  3.8).  if  G(z)  is 
stable,  then 

(i)  the  optimal  IM  controller  with  respect  to  the  SSE  of 
Theorem  3.8  (iv)  is  given  by 


Gc(z)  = G ( z ) -1  s£(z)  1 l*(l) 


(3-19) 


and  results  in  lower  triangular  closed  loop  transfer  matrix. 
This  is  proved  using  the  methodology  of  Theorem  3.8  and  the 
fact  that  Jx  is  minimized  if  the  closed  loop  transfer  matrix 
has  a pole  at  — where  Sj_  is  a finite  unstable  zero  (6)  . 

(ii)  The  optimal  IM  controller  (3-19)  provides  complete  de- 
coupling if  and  only  if  5q(z)  is  diagonal. 

Theorem  3.24.  (Generalization  of  Theorem  3.9).  If  G^  is  a 

desired  closed  loop  transfer  matrix,  then  it  is  achievable 

by  the  IM  controller  Gq  = G ^ Gd  if  and  only  if  ^ j_s 

u G G 

stable  and  proper. 

Theorem  3.25.  (Generalization  of  Theorem  3.10).  If  a diag- 
onal closed  loop  transfer  matrix  is  desired,  (G  ) • • = 

nj  z-s  • Pi  S ^ 

(i=l(lrsl^)  } thSn  thS  smallest  Possible  P±,  i = k,2 £ is 

given  by  the  highest  power  of  — _~Sl  in  the  jth  column  of  ?£. 

1— s . z G 

i 

An  Optimal  Feedforward  Disturbance  Estimator 

The  design  of  a disturbance  estimator  via  the  right  gen- 
eralized interactor  is  based  on 

Theorem  3.26.  The  estimator  E in  Figure  3-2  given  by 


E(z)  = T(z)  eg  (1)  ^(z)'1  G ( z ) -1 


where  T is  any  stable  and  proper  transfer  function  with 
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T ( 1 ) - 1 and  where  is  the  right  generalized  interactor  of 
G, is  both  proper  and  stable. 

Proof:  This  theorem  is  dual  to  Theorem  3.22. 

An  example  is  given  next.  Let 


G(z)  = 


z- . 4 z-  . 5 


. 6 . 6 

z- . 5 z- . 4 


This  transfer  matrix  has  unstable  zeros  at  1+(.3)1//2  (=  s1) 


and  at  °°  (=  S2)  • We  find 


£g,Si<z>  - 


1-  S 1 z 


z-s- 


1/2 


where  a = (.6+(.3)  ) / ( . 5+ ( . 3) x//) . Next,  letting 


0 

1-S]_Z 

Z-S]_ 

1/2, 


5G,Si(z)  G(z)  = Ki<z) 


we  find 


^l.S2U) 


z 0 

0 z 


Then 


^G(Z)  ?K1,s2(z)  5G,s1(z) 


-az 


1-sz  „ l-sz 


z-s 


z-s 


and  the  closed  loop  transfer  matrix  is  given  by 
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1 0 

G (z)  = z_1 

(sp+1)  (1-z)  z-s-i 

a i 

1 slz  1-S-j^Z 

The  IM  controller  given  by  (3-19)  is  strictly  proper  and  has 
poles  at  1/s^  and  .4,  i.e.,  it  is  both  implementable  and 
stable . 


CHAPTER  IV 

ASYMPTOTIC  STABILITY  OF 
SELF-TUNING  CONTROLLERS 

4 . 1 Introduction 

The  global  asymptotic  stability  of  adaptive  controllers 
applied  to  linear  systems  has  remained  a long-standing  open 
question  during  the  last  decade  due  to  the  implicit  time 
varying  nature  of  the  closed  loop.  The  problem  was  first 
addressed  by  Parks  (32)  , where  the  design  was  based  on 
Lyapunov's  second  method.  Feuer  and  Morse  (33)  suggested  a 
stable  algorithm  which  was,  however,  technically  involved. 
Landau  (34)  used  Popov's  hyperstability  theory  to  prove  the 
stability  of  some  continuous  and  discrete-time  model  refer- 
ence adaptive  schemes.  Also  Narendra  and  Lin  (35)  estab- 
lished the  stability  of  the  discrete  version  of  the  algorithm 
of  Narendra  and  Valavani  (36) . Goodwin,  Ramadge , and  Caines 
(15)  proved  the  stability  of  minimum  variance  adaptive  al- 
gorithms applied  to  minimum  phase  discrete-time  linear  sys- 
tems. Cordero  and  Mayne  (37)  and  Ydstie  and  Sargent  (38)  ex- 
tended these  results  to  single-input  single-output  ST  regu- 
lators employing  a variable  forgetting  factor. 

In  the  stochastic  case,  Ljung  (39,  40)  presented  a tech- 
nique for  analyzing  the  convergence  of  stochastic  self-tuning 
(ST)  regulators.  Conditioned  stability  proofs  for  stochastic 
algorithms  were  also  given  by  Goodwin,  Ramadge,  and  Caines 
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(41)  and  Sin  and  Goodwin  (42) . Landau  (43)  used  a martingale 
type  approach  to  establish  boundedness  of  the  variables  as 
well  as  asymptotic  properties.  Asymptotic  convergence  was 
also  established  for  an  adaptive  pole  placement  algorithm 
in  Goodwin  and  Sin  (44) . More  recently,  stability  issues  of 
a multivariable  adaptive  pole  placement  algorithm  were  dis- 
cussed in  Elliot  et  al.  (45) . 

In  1975,  Clarke  and  Gawthrop  (21,  46)  developed  the  self  — 
controller.  This  algorithm  not  only  does  penalize 
output  error  as  does  the  classical  ST  regulator  (mimimun  var- 
iance) , but  can  also  penalize  excessive  control  fluctuation 
and  it  follows  set-point  changes.  The  controller  is  based  on 
a cost  function  with  a priori  chosen  constant  weights.  If 
this  cost  function  is  dictated  by  economic  considerations, 
controller  design  is  easier  than  in  the  case  of  adaptive  pole 
placement  controllers,  which  can  be  shown  to  involve  time- 
varying  weights  (Goodwin  and  Sin  (44)  and  Kumar  and  Moore 
(47)).  Another  advantage  of  a constant  weights  self-tuning 
controller  is  its  simplicity.  The  control  law  is  explicit 
and  does  not  require  the  solution  of  Diophantine  equations  on 
line,  thus  avoiding  the  associated  ill— conditioning  problems 
which  might  arise  in  adaptive  pole  placement  algorithms 
(Kumar  and  Moore  (47)). 

A first  stability  analysis  for  self-tuning  controllers 
of  the  Clarke-Gawthrop  type  was  given  in  Gawthrop  (48) , with 
the  conclusion  that  the  algorithm  needed  to  be  modified  in 
order  to  guarantee  convergence.  Gawthrop  and  Lim  (2)  pointed 
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out  the  enhanced  robustness  characteristics  of  the  self- 
tuning controller  in  the  presence  of  plant  nonlinearities, 
unmodelled  disturbances,  and  plant-model  order  mismatch.  An 
overview  of  the  recent  results  was  given  in  Gawthrop  (49) . 
However,  the  asymptotic  convergence  of  the  self-tuning  con- 
tr°Her  ^as  n°t  been  established  yet  (Kumar  and  Moore,  (47)  , 
Ydstie  and  Liu  (50)  ) , albeit  the  fact  that  it  constitutes  one 
of  the  few  viable  adaptive  controllers  for  nonminimum  phase 
systems  (Clarke,  (3)). 

This  section  establishes  the  asymptotic  stability  of 
single-input  single-output  (SISO)  and  multiple-input  multiple- 
output  (MIMO)  STCs  of  the  above  type,  i.e.,  based  on  the  mini- 
mization of  a quadratic  performance  index  which  includes  penal- 
ization of  both  output  and  input  deviation  as  well  as  velocity. 
First,  some  properties  of  the  most  widely  used  parameter  esti- 
mators are  stated.  Then  a stability  proof  is  given  for  a mod- 
ified version  of  the  MIMO  STC  of  equation  (2-21)  applied  to 
minimum  phase  systems . 


9 = x ( t-1) F ( t-1) x ( t-1) , F is  the  covariance  matrix 

(see  Appendix  A)  and  s = 1 or  s = A(t) (the  forgetting 
factor)  depending  on  the  estimator. 


4.2  Properties  of  the  Parameter  Estimators 


1.  lim  v ( t ) = 0 where  v ■ (t) 


e j (t) 


172  ' 


( s+g ( t+1) ) 


2.  lim  0(t)  =0  and 

, 00 


9(t)  ||  < ||  O(t-l)  ||  < ||  0(0)  || 
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where  0(t)  = 0-0 (t)  and  0 = 

II  F(t)  ||  < C < and  lim  F(t)  = FOT  ; C,  Foo  are  constants. 

t->°° 

4.  | g ( t-1)  | < C ||  x(t-l)  ||  2 

5.  lim  H ( t)  = 0 where  H(t)  = 0(t-d)-0(t) 
t-»-°° 


The  above  properties  were  established  in  (15) , (31) , (38) , 

(41)  , (51)  , and  (52)  . 

4.3  Some  Technical  Lemmas 
The  following  lemmas  will  be  needed  further: 

Lemma  4.1.  Let  p(t)  and  q(t)  be  real  vector  sequences  re- 
lated by 

G1  ( ^ 1)p(t)  = G2  (q--'-)  q ( t) 

where  (q  ^ and  G2 (q-1)  are  matrix  polynomials  in  the  back- 
ward shift  operator  q 1,  and  Gg(q--^-)  is  stably  invertible, 
that  is,  det(G1(z-1))  ± 0 for  |z|  > 1.  Then 
(i)  there  exist  nonnegative  constants  k-j_  and  k2  such  that 

||  p(t)  ||  < kq+k2  max  ||  q(r)  ||  (4-1) 

O^r^t 


(ii)  if  lim  q(t) 
t->00 


0,  then  lim  p(t)  = 


0 


(4-2) 
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Proof : The  results  are  standard  if  the  system  is  viewed  as  a 

forced  linear  system  with  input  q(t)  and  output  p(t) . 

Lemma  4.2.  Let  p(t),  q(t)  be  sequences  in  Ra,  Rm,  respec- 
tively and  let  G(t)  be  an  £xm  real  matrix  with  lim  G(t)  = 0. 

t-**> 

If  there  exist  nonnegative  constants  kp  and  k2  such  that 

||  q(t)  ||  < kp+k2  max  ||  p (x) +G  (r)  q (x)  ||  (4-3) 

0<x<t 


then  there  exist  nonnegative  constants  k3 , k4  such  that 


II  q(t)  ||  < k3+k4  max  ||  p(x)  || 

0<T<t 


Proof : Inequality  (4-3)  implies  that  for  large  enough  t 


max  ||  q ( t ) ||  < kp+k2  max  ||  p(T)  j|  + 
0<T<t  0<X<t 


k2  max  [ ||  G ( x ) ||  ||  q(T)  ||  ] + 
0<x<T 


k2  max  [ ||  G ( t ) ||  ||  q(T)  ||  ] (4-4) 

T<x<t 

where  T«*>  is  fixed  and  such  that  ||  G(t)  ||  < l/2k2  for  t>T- 
Such  a time  T exists  since  lim  G(t)  = 0.  From  inequality 
(4-4)  it  follows  that 

max  ||  q ( x ) ||  < kp+k2  max  [ ||  G(i)  ||  ||  q(T)  ||  ] + 

T<x<t  0<x<T 

(4-5) 

k2  max  ||  p(x)  ||  + 1/2  max  ||  q(T)  || 

0<x<t  T<x<t 


or 
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1/2  max  ||  q ( x ) ||  < M+k2  max  ||  p(x)  ||  (4-6) 

T<x<t  0<x<t 

where 

M = ki+k2  max  I II  G(t)  ||  ||  q ( x ) ||  ] <»  (4-7) 

(Kt<T 

From  the  above  inequality,  one  obtains  the  result  with  k2  = 

2M+N  and  k4  = 2k2,  where  N = max  ||  q(x)  ||  <«  . 

0<t<T 

Lemma  4.3.  If  r(t) , s(t)  are  real  scalar  sequences  and  p(t) , 
q(t)  are  sequences  in  satisfying 

lim  li—Blt)  II  2 = o (4-8) 

***  r(t)+s(t)  ||  q(t)  ||2 

then  subject  to 

(i)  0 < r ( t)  < k1#  0 < s ( t ) < k2,  kx  < oo,  k2  < oo  (4-9) 

(4-10) 

(ii)  ||  q(t)  ||  < c,+c?  max  ||  p(r)  ||  , 0 < c-,  < «> , 0 < c0  < «= 

0<r<t  2 

it  follows  that  lim  p(t)  = 0. 

Proof : See  Goodwin  et  al.  (15). 

4.4  Asymptotic  Stability  of 
Self-Tuning  Controllers 
for  Linear  Minimum-Phase 
Systems  with  Multiple  Delays 

It  is  established  here  that  a class  of  quadratic  STCs 

achieves  asymptotically  the  control  objective  for  any  initial 

conditions  of  a linear  plant  and/or  the  estimator,  while  all 

process  variables  remain  bounded. 

Consider  the  system  (2-16)  with  £=m  and  the  performance 

measure  (2-20) . The  optimal  controller  with  respect  to  (2-21) 

is  given  by 
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D(0)"Q1  e(t+d+l)+Q2v(t)+Q  (v(t)-v(t-l))  = 0 (4-11) 

or,  assuming  that  D(0) 'q  is  invertible, 
e (t+d+1) +Q (q-l) y ( t)  = 0 

where 

Q(q  1)  = Q4+Q5 (l-q_1) ; Q4  = (D(0) 'qx) _1Q2, 
q5  = (d(0) 'q1)"1q3 

One  can  now  choose  Q4 , Q5  if  an  a priori  estimate  of  D ^ ^ 
is  available.  Guidelines  for  obtaining  a estimate  are 

given  in  Peltomaa  and  Koivo  (53) . 

The  above  modification  makes  the  control  law  linear  with 
respect  to  the  estimated  parameters.  Since  e(t+d+l)  is  un- 
known at  time  t,  it  is  substituted  by  its  estimate  and  the 
implementable  control  law  is 

e(t+d+l)+Q(q_1)v(t)  = 0 (4-12) 

where 

e(t+d+l)  = 0 (t) x (t+d) -ys 

Suppose  now  that  the  direct  estimation  scheme  is  used  to  esti- 
mate the  parameters  of  (4.12). 

Lemma  4.4.  The  following  are  true 

(i)  £ (t)  = 0 (t-1) x ( t-1) 


where 
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£ (t)  [ £ j ( t)  / ^2  ' • * * ' e ] 

£j(t)  = Yj (t+kj-k) -0_. (t-l)x(t-l) 

(ii)  e ( t)  = 0(t-d-l)x(t-l)-Q(q-1)v(t-d-l) 

(iii)  e(t)  = e(t)+H(t-l)x(t-l)-Q(q-1)v(t-d-l)  (4-13) 

where 

H(t-l)  = 0 (t— d— 1) — 0 (t— 1) 

Proof : 

(i)  From  (2-22)  and  the  definition  of  gj (t) , (i)  follows 

readily . 

(ii)  From  the  control  law  (4-12),  v(t-d-l)  is  such  that 
0 (t-d-1) x (t-1) +Q (q_l) v (t-d-1)  = ys 
From  the  definition  of  e(t),  it  also  follows  that 
e ( t)  = 0x(t-l)-ys 

Combining  the  above  two  equations,  one  obtains  the  re- 
sult . 

(iii)  Multiplication  of  H(t-l)  on  the  right  by  x(t-l)  and  use 
of  (i)  and  (ii)  yield  the  result 
Lemma  4.5.  The  tracking  error  dynamics  are  described  by 

G1(q_1)e(t)  = G2 (q-1) [e (t) +H (t-1) x (t-1) ] (4-14) 

where  Gq(q  1)  , G2  (q-1)  are  matrix  polynomials  in  q-1  and 
Gq(q-1)  is  stably  invertible  if  and  only  if 


G(q  1)  = B (q  1) +A (q_1) Q (q_1) 
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is  stably  invertible. 

Proof . For  Q = 0,  (4-14)  follows  from  (4-13)  with  Gp(q-1)  = 

G2  (q  ■'")  =1.  Now  let  Q ^ 0.  We  are  interested  in  the  case 
where  Q4+Q5  is  nonsingular.  Then  from  Gohberg  et  al.  (54) , 
there  exist  unique  matrix  polynomials  S (q-1)  and  T (=  constant 
since  degree  of  Q(q_1)  in  q-1  is  1)  such  that 

B(q-1)  = S(q-1)Q(q-1)+T  (4-15) 

Specifically  in  this  case, 

n 

T = --o  ( (Q4+Q5) _1Q5) n_1 

which  we  assume  to  be  nonsingular.  Substituting  now  from 
(4-15)  in  the  error  form  of  model  (2-16) , namely 

A(q_1)e(t)  = B(q-1)  v(t-d-l) 

and  dropping  the  argument  q--'-  for  convenience,  one  obtains 
after  using  (4-13) 

Ae(t)  = S[e  (t)+H(t-l)x(t-l)-e(t)  ]+Tv(t-d-l)  (4-16) 

Solving  (4-16)  for  v(t-d-l)  and  substituting  in  (4-13)  yields 
(4-14)  with 

G2  = I+QT-1S  (4-17) 

Gl  = g2+qt_1a 


(4-13) 
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It  is  seen  that  degree  (G-^  (q  ^)  ) = n+2  and  that  degree 
(G2(q-1))  = n.  Finally,  use  of  (4-15)  in  (4-18)  results  in 

QT-1G  = GXQ 

It  then  follows  that  det  G±  = c det  G where  c = det(T-1)  is 
nonzero  since  T was  assumed  to  be  nonsingular.  It  follows 
that  Gj_  is  stably  invertible  if  and  only  if  G is  stably  in- 
vertible . 

The  overall  asymptotic  stability  of  the  closed  loop  is 
established  next  for  minimum-phase  systems.  The  proof  given 
here  is  a generalization  of  the  proof  in  Goodwin  et  al.  (15) , 
which  concerned  the  case  Q4  = Q5  = 0.  The  fact  that  the 
weights  Q4 , Q5  have  to  be  chosen  suitably  is  pointed  out  here. 
Theorem  4.6.  Under  the  assumption  that  det  B (z) +A(z) Q (z)  ^ 0, 
1 2 1 <1,  the  controller  (4-12)  when  applied  to  a minimum- 
phase  system  (2-16)  leads  to 

lim  e ( t)  = 0 
t->°° 

via  a bounded  sequence  v(t) . 

The  assumption  deserves  some  comments.  If  the  process  is 
controlled  by  the  optimal  control  law,  then  the  closed  loop 
system  is  described  by 

G1(q"1)e(t)  = 0 

Hence,  a necessary  condition  for  stability  is  that  det  G(z)  ^ 
0,  | z | <1.  It  is  also  noted  that  for  Q4  =05  = 0,  the  above 

assumption  is  vacuously  true. 
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Proof:  From  (4-14) , we  have 

G|_(q  ^)e(t)  = G2  (q--'-)  £ (t) +G2  (q~^)  H (t-1)  x ( t-1) 

Since  the  system  is  minimum  phase,  B(q-^-)  is  stably  invertible 
and  from  Lemma  4 . 1 it  follows  that  there  exist  nonnegative 
constants  c{,  so  that 

[|  v(t-a-l)||  < c,+c7  max  ||  e(x)  || 

O^x^t 

from  which  one  finds  c^,  C2  nonnegative  such  that 

||  x(t-l)  ||  < c-j+c,  max  ||  e (x ) ||  (4-19) 

0<T<t 


Then  it  also  follows  from  properties  1 and  4 of  the  estimators 
that  for  some  constant  nonnegative  c3 , c4 

||  e(t)  ||  < (c3+c4  max  ||  e(x)  ||  ) ||  v (t)  ||  (4-20) 

0<x<t 


and  (4-14)  gives,  in  view  of  (4-19)  and  (4-20)  , 


(4-21) 


II  Gi  (q-1)  e (t)  ||  < E ||  G2i||  (c3+c4  max  ||  e (x ) ||  ) ||  v (t-i)  ||  + 
i=0  0<x<t 


n 


n 


E II  G?i  II  ||  H(t-i-l)  ||  (c-j+Cp  max  ||e(x)||) 
i=0  0<x<t 


Case  I . e(t)  bounded. 
Then  since  lim  v(t) 

t-Ko 

lim  ||  G1(q-1)e(t)  ||  = 0, 


i.e.,  ||  e(t)  ||  M,  M real  nonnegative. 

= lim  H ( t)  = 0 , we  get  that 
£-»-00 

which  in  view  of  Lemma  4.1  (ii)  yields 


lim  e ( t)  = 

t“^00 


0. 
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Case  II.  e(t)  unbounded. 

Let  Gq(q  -'-)e(t)  = p(t).  Then  from  Lemma  4.1,  p(t)  is  also 
unbounded,  i.e.,  there  exists  subsequence  {tk>  along  which 

II  II  = max  II  P(t)  ||  and  lim  ||  p(tk)  ||  = “ (4-22) 

0<x<tk  k-**> 


Also,  since  Gq  is  assumed  to  be  stably  invertible  by  Lemma  4.1, 
there  exist  nonnegative  constants  kq,  k2  such  that 

max  ||  e(x)  ||  < kq+k2  max  ||  p(x)  |j 
0<T<t  0<X<t 


Then  (4-21)  becomes 


II  P(t)  ||  <{c3+C4{k1+k2  max  ||  p(i)  ||  }}b(t)  + 

O^T^t 

{Ci+C2(k1+k2  max  ||  p ( x ) ||  }}c(t) 
CKx^t 

where 

b(t)  = z ||  G2i  ||  ||  v(t-i)  || 
i=0 


c(t)  = Z ||  G2i  ||  ||  H(t-i-l)  || 
i=0  1 


and 


lim  b (t)  = lim  c (t)  = 0 
t-*»  t-»-<» 


(4-23) 


(4-24) 


Considering  now  (4-23)  along  {tk}  and  for  large  enough  tk  we 
have 

0 < II  P (tk)  ||  {1-C4k2b(tk)-C2k2c(tk)  } < (C3+C4k1)b(tk)  + 


(C1+C2k1) c (tk) 
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and  then  (4-24)  forces 


lim  ||  P ( tk)  ||  U-C4k2b(tk)-C2k2c(tk)  } = 0 


However,  by  directly  calculating  this  limit  using  (4-22)  , one 
finds  it  equal  to  ® • 1 = °°,  a contradiction.  Hence,  Case  II 
is  impossible  and  the  result  follows  from  Case  I.  Conse- 
quently, (4-19)  implied  the  boundedness  of  v(t). 


Asymptotic  stability  is  established  for  linear,  minimum, 
and  nonminimum  phase  systems  controlled  by  STCs.  The  latter 
are  based  on  generalized  cost  function  criteria  in  which  the 
weights  are  polynomial  matrices  in  q--^- . The  systems  can  have 
an  arbitrary  input-output  delay  structure. 

Self-Tuning  Controllers  Based  on  Measurement-Control  Delay 
Factorization 

The  system  is  assumed  to  be  described  by  (3-4)  and  to 
accept  the  factorization  which  transforms  it  to  the  form  (3-6) . 
The  control  law  is  given  by  (3-12) . 

For  estimating  the  controller  parameters,  model  (3-6)  is 
rewritten  as 


4 . 5 Asymptotic  Convergence  of 
Self-Tuning  Controllers 


yj (t)  = x j (t-i) e j 


where 


Xj (t-1)  = [1  yj (t-d-1) . . .yj (t-d-x-1)  v' (t-r-kj-1) . . . 
v' (t-r-d-kj-1) ] 


d(0) ...ofn+d) 
3 J 
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and  where  subscript  j denotes  jth  row  and  subscript  jj  de- 
notes the  jth  diagonal  element.  Note  that  from  (2-6)  the 
C(^  matrices  are  diagonal. 

The  parameter  estimator  in  this  case  would  involve  l re- 
gression vectors  and  l covariance  matrices,  e.g.,  RLS-VFF2-MR 
in  Appendix  A.  Let 


0 = diag[e_j] 

H(t-l)  = diag[Hj (t+kj-k-1) ] 

Hj (t+kj-k-1)  = 0j (t-d-1) -0^ (t+kj-k-1) 

e (t)  = [e^ (t+kg-k) e2 (t+k2~k) . . . (t+k^-k) ] 

x (t-D " = [xg (t+kg-k-l) x2 (t+k2-k-l) . . .X£ (t+k£-k) ] 

Then  the  input  and  output  error  dynamics  are  described  by 
Lemma  4.7. 


e (t) 

0 0 

' 

II 

r — 1 

1 

o 

= 

v (t-d-1) 

o P(q‘ 

-1) 

where 

A (q  -1) 

-B (q-1) 

G (q-1)  = 

P(q_1) 

Q (q_1) 

0 


(4-25) 


e (t)+H(t-l)x(t-l) 


Proof:  The  upper  part  of  (4-25)  is  simply  the  error  form  of 

model  (2-16) . in  addition,  from  the  control  law  and  the 


parameter  estimator,  we  obtain 


86 


P (q  1) [e (t) -0 (t-d-l)x (t-l) ]+Q(q_1) v(t-d-l)  = 0 (4-26) 

and  since 

£j (t)  = e j (t-l) Xj (t-l) 

using  the  definition  of  H(t-l),  we  can  rewrite  (4-26)  as 

P(q_1) [e(t)-e (t) -H (t-l) x ( t-l) ] +Q (q_1) v ( t-d-1)  = 0 

from  which  the  lower  part  of  (4-25)  follows. 

Theorem  4.8.  Subject  to 
(i)  K(q"l),  R (q-^)  and  n are  known 
(ii)  det  G(q-l)  ^ 0 for  |z|  > 1 

the  STC  (3-12)  applied  to  a system  described  by  (2-18)  leads 
to 

lim  y ( t)  = y , lim  u(t)  = uc 
t-*»  t-*» 

while  all  process  variables  remain  bounded. 

Proof : From  Lemma  4.1  and  from  (4-25),  it  follows  that  there 

exist  positive  constants  kj_,  k2  such  that 

(4-27) 

||  e'(t)  , v' (t-d-1)  ||  < ki+k2  max  II  e (r)+H(r-l)x(r-l)  || 

0<r<t 

From  the  definition  of  x(t-l),  it  follows  that  there  exist 
positive  constants  k3 , k4  for  which 

||  x(t-l)  ||  < k^+k4  max  ||  e"(t)  , v"(t-d-l)  || 

0<r<t 

This  implies,  in  view  of  (4-27) , property  5 of  the  estimators, 
and  Lemma  4.2,  that  for  the  positive  constants  kp  = k3+k4k1, 

k2  = k4k2 
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||  x(t-l)  ||  < k3+k4  max  ||  e (r)  |[  (4-28) 

0<r<t 

Now  using  the  inequality 


4 -1  i a , 

2 aiei  ^ E ai^  ( 2 ei^  for  a-  > 0,  8-  > 0 

i=l  i=l  i=l  1 1 


properties  1 and  4 of  the  parameter  estimators  give  that  for 
c-]_  = lr  c2  = C 

1 im  ll£  (t)  II _ q 

t^oo  Ci+02  11  x(t-l)  ||  2 


It  thus  follows  from  Lemma  4.3  that  lim  e (t)  = 0.  Then  from 

t-*» 

(4-28),  one  obtains  that  x(t-l)  is  bounded  and  that 
lim[  e (t)+H  ( t-1)  x (t-1)  ] = 0.  This,  in  conjunction  with  (4-25) 
and  Lemma  4.1,  gives  that  lim  e(t)  =0  and  lim  v(t-d-l)  = 0. 
Consequently,  y(t)  tends  to  ys  (no  offset)  and  u(t)  tends  to 
us.  This  completes  the  proof. 

Self-Tuning  Controllers  Based  on  the  Right  Interactor 

The  system  is  assumed  to  be  of  the  form  (3-2)  and  the  con- 
trol law  is  given  by  (3-18) . Since  C(q-1)  is  not  necessarily 
diagonal,  in  this  case  the  estimation  scheme  is  based  on 


y(t)  = 0x(t— 1) 


where 

0 = [C(0)...C(n)  D (°) . . .D (n+d) ] 

x'(t-l)  = [y"  (t-d-1) . . .y' (t-d-n-1)  v'(t-d-l)...  v'(t-d-n-l)] 


88 


Such  an  estimation  scheme  involves  one  regression  vector  and 
one  covariance  matrix,  e.g.,  the  scheme  RLSVFF2  in  Appendix  A. 
The  equation  which  describes  the  error  dynamics  is 


e (t) 

0 

0 

0 

v(t-d) 

0 

p (q-1) 

e (t) +H ( t-1) x ( t-1) 

where  G(q  is  as  in  Lemma  4.7.  Then  Theorem  4.8  applies 
mutatis  mutandis  and  gives  that  lim  e(t)  = 0 = lim  v(t).  Con- 

t-X»  "t" *°° 

sequently , assuming  that  the  right  interactor  is  known. 

Theorem  3.10  (ii)  gives  lim  u(t)  = us. 

t-X» 

Special  Cases 

1.  The  single  input-single  output  STC  of  Clarke  and  Gawthrop 
(21) . in  this  case,  there  is  one  delay,  k,  present  and 
the  delay  factorization  is  trivial,  i.e.,  K(q_1)  = q_k  and 
R(q-1)  = 1.  The  stability  condition  becomes 

P (q-1)B(q-1 2)+Q(q-l)A(q-l)  f£  0 for  |q|  ^ 1 

where  P (q_1)  , B(q_1),  Q(q_1),  and  A(q“l)  are  scalar  poly- 
nomials. A detailed  analysis  of  the  algorithm  can  be 
found  in  (55) . 

2.  The  multivariable  STC  of  Koivo  (17).  In  this  case, 

K(q  ^)  = q k I and  R(q-^)  = I.  Note  that  since  K(q--'-)  = 
q_k  I,  one  does  not  need  to  start  from  an  A (q-1) -diagonal 
parametrization . Again,  if  P and  Q are  chosen  such  that 
G is  stably  invertible,  the  algorithm  is  asymptotically 


stable . 
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3.  The  case  that  P (q  1)  and  Q(q  1)  cominute.  The  stability 
condition  then  becomes,  by  using  Schur ' s formula  (56)  for 
the  evaluation  of  partitioned  determinants, 

det[A(q_1)Q(q-l)+B(q-l)p(q-l)]  ji  0 for  |q|  S*  1 

i * e • , AQ+BP  should  have  no  latent  root  outside  the  open 
unit  circle. 


CHAPTER  V 
CONCLUSION 

This  work  has  addressed  the  problem  of  discrete-time 
control  of  multivariable  plants.  Convergent  adaptive  al- 
gorithms have  been  introduced  which  can  treat  open  loop 
unstable  or  nonminimum  phase  systems.  The  factorization 
of  the  invariant,  under  feedback  control,  part  of  a transfer 
matrix  led  to  the  design  of  optimal  Internal  Model  Control- 
lers and  disturbance  estimators.  A number  of  problems  have 
not  been  treated  in  this  work  and  may  be  challenges  for 
further  research.  Stochastic  considerations  and  influences 
of  time  varying  parameters  have  not  been  treated.  Non- 
linearities  were  not  included  in  the  proposed  adaptive 
schemes.  Although  the  design  of  many  nonlinear  adaptive 
controllers  may  retain  the  essential  simplicity  of  the 
linear  case  the  stability  issue  is  still  open.  The  stabil- 
ity of  indirect  adaptive  controllers  is  a subject  of  cur- 
rent research  also.  Finally,  stable  and  causal  inversion 
remains  a challenge  for  many  nonlinear  systems. 
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APPENDIX  A 
PARAMETER  ESTIMATORS 

There  are  several  methods  for  estimating  the  parameter 
vector  0,  for  example,  the  projection  method  (Goodwin  et  al., 
(15))  given  in  A.l.  However,  due  to  their  computational  sim- 
plicity and  speed  of  convergence,  recursive  least  squares 
(RLS)  estimators  are  by  far  the  most  popular.  Four  types  of 
RLS  estimators  are  commonly  used  for  STCs,  namely: 

1)  RLS  "standard"  algorithm  (RLS-SA) . The  equations  for  this 
algorithm  are  given  in  A. 2.  They  include  a modification 
first  given  by  Goodwin  et  al.  (15) , which  ensures  that  the 
matrix  [B 0 ( t) +Q ( 0) ] is  always  nonsingular,  i.e.,  that  the 
control  law  is  solvable  for  u(t). 

2)  RLS  with  variable  forgetting  factor  (RLS-VFFl) (Kershenbaum 
and  Ydstie.  (57);  Ydstie  and  Sargent  (38)).  By  forgetting 
past  data,  this  algorithm  allows  the  estimates  to  adapt 
faster  to  changes  in  the  plant  parameters  due  to  load  or 
set  point  changes.  But  the  forgetting  ceases  when  close 
to  steady  state,  thus  limiting  burst  phenomena.  The  al- 
gorithm is  described  in  A. 3. 

3)  Approximate  RLS  with  variable  forgetting  factor  ( RLS-VFF2 ) 
(Fortescue,  Kershenbaum,  and  Ydstie  (58) ; Cordero  and 
Mayne  (37)).  This  is  an  approximation  of  the  previous 
algorithm  which  requires  fewer  calculations  without  sac- 
rificing performance.  The  algorithm  equations  are  given 
in  A. 4 . 
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4) 


1) 

2) 

3) 

4) 


1) 

2) 

3) 

4) 

5) 


1) 

2) 

4) 

5) 

6) 
7) 


RLS  multiple  regression  (RLS-MR)  applicable  to  cases  where 
more  than  one  regression  vector  is  present.  Such  an  al- 
gorithm is  given  in  A. 5. 


e (t)  = 

g(t-i) 
0(t)  = 


A.l  Projection  Method 
w(t)  -0  (t-l)x(t-l) 


= x '(t-1) X (t-1) 

0 ( t-1)  +a  ( t)  e(t)x  ’(t~1) 
l+g(t-l) 


0<ap<a ( t) < a 2 < 2 


(normally  a(t)  = 1) 

If  D^°^+(P(0)-1Q(0)  is  singular,  change  a (t)  and  go  to 
step  2. 


A. 2 RLS-SA 

e(t)  = w(t) -0  (t-l)x(t-l) 

- a (t) x' (t-1) F (t-1) x (t-1) , a (t)  is  as  in  the 
projection  method 

0(t)  = 0 ( t-1)  +a  ( t)  £_(_t)x  (t-1)  F (t-1) 

„ l+g(t-l) 

If  [Dq+  (P  (0) ) -1Q (0) ] is  singular,  change  a(t)  and  go  to 
step  2. 

F(t)  = [ I — ot  ( t ) x ( t_1)  x — (t-1)  ] p ( t-1) 

1+g (t-1) 


A. 3 RLS-VFF1 

as  in  RLS-SA 

P(t)  = 1-g  (t-1) -a  (t)  - — K £ (t) 

N0 

where  Nq  > 0,  K = pos.  def.  matrix 

i(t)  = [p(t)+  (p(t)  2+4g(t-l))  1/2]/2 

0(t)  = 0 (t-1)  +a  (t)  £ (t)x^  (t-l)F  (t-1) 

. A ( t ) +g ( t-1 ) 

as  in  step  4 of  the  RLS-SA 


F (t) 


[I-a(t)  F (t-l)x(t-l)x"(t-l)  j 
A ( t) +g (t-1) 


F ( t-1) / A ( t) 
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A. 4 RLS-VFF2 


1-4)  as  in  RLS-SA 
5) 


6) 


7) 

1) 

2) 

3) 

4) 


W(t)  = [I-a(t)  I(t-l)x(t-l)xJ(t-l) 

1+g  ( t— 1)  J 

A(t)  = max  [ A(t)  , Amj,n,  trace  (W(t))/F] 

e"  (t)K  e (t) 

njl  ( i+g  (t-i) ) ' 


where  »(t)  = 1 - e'(t)K  e(t)  . Nj_  > 0,  K = pos.  def. 


F > trace  (F  ( 0) ) , 

0 <.  Vin  < 1 

F(t)  = W ( t)  / A ( t) 


A. 5 RLS-VFF2-MR 


£j(t)  = y(t)-Xj  (t-1)  0j  (t-1) 

g-j(t-l)  = a(t)Xj  (t-l)Fj  (t-l)Xj  (t-1) 

6j(t)  = 9 j ( t-1)  +a  ( t)  --j(t~1)Xj(t-1)  e.(t) 
3 3 ltgj(t-l) 

same  as  in  RLS-SA 


5 7)  same  as  in  RLS-VFF 2 for  each  Aj (t)  and  for  each 
covariance  Fj (t)  corresponding  to  Xj (t-1) . 


matrix , 


APPENDIX  B 

THE  INTERACTOR  MATRIX 

The  following  establishes  the  existence  of  the  left  inter- 
actor matrix  £(z)  in  (8). 

First  we  note  that  given  a nonsingular  and  strictly  proper 
transfer  function,  G(z),  there  exist  unique  integers  kj_ , 
i = 1,2,... ,z  such  that 

lim  zki  Gj_(z)  = Gj_(z)  = ith  row  of  G(z) 

z -H» 

is  both  finite  and  nonzero. 

We  define  the  first  row  £(z)  of  E,  (z)  by 

5 (z)  = (zkl  0. . .0) 

so  that 

lim  C(z)q  G ( z ) = x1  = Cq 

Z-x» 

if  is  linearly  independent  from  tq  = £q,  then  we  get 
5 (z) 2 = (0  zk2  0. . .0) 
so  that 

lim  5 (z)  2 G (z)  = t 2 

Z^-co 

On  the  other  hand,  if  t2  and  5 q are  linearly  dependent  so 
that  x 2 = aq5j_,  with  aq  ^ 0,  we  let 
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1 

|1(z)2  = zk2[(0,  zk2  0...0)-a1\(z)1] 


where  k2  is  the  unique  integer  for  which 


lim  5 1 ( z ) 2 G(z)  = £ 1 
Z-x»  ^ 


is  both  finite  and  nonzero.  If  \\  is  linearly  independent  of 
£q,  we  get 

5 (z)  2 = CX(z)2 


and  note  that 


lim  £ (z)  5 G (z) 
z-*-°° 


^1 


is  linearly  independent  of  £■ 


'v 1 


- „ 2 , 


52  = al^l 


If  not,  then 


and  we  let 

2 

£2(z)2  = zK2  [ £ !(z)  2-ctq£  ( z ) x ] 

2 

where  k2  is  the  unique  integer  for  which 
lim  %2  (z)  2 G ( z ) = \2 

Z ->-co 


is  both  finite  and  nonzero.  If  |2  and  ^ are  linearly  inde- 
pendent, we  get 

5 (z) 2 = X2  (z) 2 
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and  if  not,  we  repeat  the  procedure  until  linear  independence 
is  obtained.  The  procedure  must  terminate  since  det  G(z)  ^ 0 
almost  all  z and  since  kj.  > 1 , i = 1 , 2 , . . . , i . The  remaining 
rows  of  5(z)  are  obtained  in  an  analogous  fashion.  Finally, 

uniqueness  of  (z)  can  be  establizhed  as  in  Wolowich  and  Falb 
(8)  . 


APPENDIX  C 

PROOF  OF  EQUATIONS  (2-6) 

Equations  (2-6)  will  be  shown  for  any  positive  integer  p 
in  place  of  k or  d by  use  of  induction.  The  proof  given  here 
corresponds  to  model  (2-16) . Model  (2-3)  is  a subcase  of 
model  (2-16) . 

Step  1.  For  p = 0,  trivial  since  the  model  (2-18)  results. 

For  p = 1,  equations  (2-6)  are  easily  verified  by 
substituting  w(t+l)  in  the  right  hand  side  of  (2-18) , 
via  (2-18)  for  p = 0. 

Step  2.  Assume  that  (2-19)  and  (2-6)  are  true  up  to  p = p. 

S i_ep  3.  It  will  be  proved  that  (2-19)  and  (2  — 6)  are  true  for 

p = p+1. 

From  (2-18) : 

w ( t+p+1 ) = s+A^  w(t+p) +. . .+A(n^w(t+p-n) 

+B(0) V(t+p-k£-rm)+. . .+B(n) v(t+p-k£-rm-n) 
But  frorr  step  2 w(t+p)  , w(t+p-l)  . . .w(t+l)  can  be  substituted 
via  (2-19).  The  result  is: 
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w ( t+p+1 ) = s+A(0)[R  s + Z C (l)  w (t-i)  + z DU)v(t+p-l-rm-k„-i)] 

i=0  P i=o  m * 

Cl  1 n n+p-2 

+ A [Rp_ps+  Z w(t-i)  + Z D 1!  v(t+p-2-rTT1-k9-i)] 

i=0  P-1  i=0  P-1  1 

+...+  A(P-1)[R1s+  z C(l)w(t-i)+  z D {i) v (t-r  -k0 -i) ] 

i=0  i=o  1 m 

A w(t)+A^P  ^ w ( t-1)  + . . . +A  W ( t+p-n)  + 

+ B(0) v(t+p-k£-rm)+B(1) V(t+p-k£-rm-l) 

+ . . . +B  ^ v (t+o-k^-rm-n) 
or 

W (t+p+1)  = [I+PZ  A(k)R^_k]s+[PZ1A(k)C(01)+A(p)  ]w(t) 
k=0  * k=0  P_K 


+ •••+  [ Z A(k)  C (l|_+A(p+l)  ]w(t-i) 
k=0  P_K; 


+ ...+  [PZ  A^k^C^n  P^*  ^ 
k=0 


p_k  +A'  ]w( t+p-n)  + 


[PZ  A(k)C^n  p+1) ]w(t+p-n-l)  + 
k=0  p-K 


p 1 

+ ■ • • + [ Z A(k)C^n|]w(t-n)  + 
k=0  P K 


+ B(0)v(t+p-k  -rm)  + [A(0)D^0)+B(1)  ]v(t+p-k  -r  -1)  + 


£ m 


+ [A(0)D^1)+A(1)D^}+B(2)]v(t+p-k£-rm-2)  +...+ 


+ [A^D  (n_1)  4-A^1)  D (n_2) 

P P-1 
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+ . . . +A ' 


(p-l)D(n-P)  o.n(n) 


+B  ]v(t+p-k. 


+ [ A ^ ) p ( n ) + A ^ 1 ) d ^ n ^ ^ 

P P— 


+ . . .+a(P  1)  D jn~P+l)  ]v(t+p-kji-rm-n 


+ [A(0)D(n+P-1)+A(1)D{n+P“2) 

P p-1 


+ . . .+A(p_1)D:[n)  ]v(t-k£-rm-n) 


from  which  (2-6)  follows. 


-rm-n)  + 


-1)  + 


REFERENCES 


Astrom,  K.  J. , and  Wittenmark,  B.  Automatica,  9,  185 
(1973).  “ 

Gawthrop,  P.  J. , and  Lim,  K.  W.  IEE  Proc.  Pt.  D. , 129, 
21  (1982). 

Clarke,  D.  W.  Automatica,  20 , 501  (1984). 

Francis,  B.  A.,  and  Wonham,  W.  M.  Automatica,  12,  457 
(1976). 

Brosilow,  C.  B.,  and  Tong,  M.  AIChE  J. , 24,  492  (1978). 

Garcia,  C.  E.,  and  Morari,  M.  Ind.  Eng.  Chem.  Process 
Des.  Dev.  , 2_4,  472  (1985). 

Bradley,  R.  H. , and  Morari,  M.  Chem.  Eng.  Sci.,  40, 

1229  (1985). 

Wolowich,  W.  A.,  and  Falb,  P.  L.  SIAM  J.  Control  and 
Optim.  , 14_,  996  (1976). 

Wellstead , P.  E. , Edmunds,  I.  M. , Prager,  D.  L. , and 
Zanker,  P.  Int.  J.  Control,  30 , 1 (1979). 

• 

Astrom,  K.  J. , and  Wittenmark,  B.  Proc.  IEEE,  127,  120 
(1980). 


Prager,  D.  L. , and  Wellstead,  P.  E.  IEE  Proc.  Pt.  D. , 
128,  (1),  9 (1980). 


Vogel,  E.  F.,  and  Edgar,  T.  F.  Proc.  ACC,  536,  Los 
Angeles,  California,  June  20-22  (1982). 

Keviczky,  L. , Hethessy,  J. , Hilger,  M.  and  Kolostori,  J. 
Automatica , 14 , 525  (1978) . 

Borisson,  U. , Automatica , 15 , 209  (1979). 

Goodwin,  C.  G. , Ramadge,  J.  P.,  and  Caines,  E.  P.  IEEE 
Trans.  Autom.  Control,  25 , 449  (1980) . 

Bucholt,  F.,  and  Kummel,  M.  Automatica , 17,  737  (1981). 


Koivo,  H.  N.  Automatica,  16,  351  (1980). 


101 


18.  Keviczky , L. , and  Kumar,  K.  S.  P.  int.  J.  Control  33 

913  (1981).  ' — ' 

19.  Bayoumi,  M.  M. , Wong,  Y.  K. , and  El-Bagouri,  M.  A. 

Automatica,  17 , 575  (1981) . 

20.  Bar-Shalom,  Y.,  and  Tse,  E.  IEEE  Trans.  Aut.  Control, 

19,  494  (1974) . 

21.  Clarke,  D.  W. , and  Gawthrop,  P.  J.  IEE  Proc . Pt.  D, 

122,  929  (1975) . 

22.  Kailath,  T.  Linear  Systems,  Prentice-Hall,  Englewood 

Cliffs,  New  Jersey  (1980). 

23.  Wolowich,  W.  A.  Linear  Multivariable  Systems,  Sprinaer 

Verlag,  New  York  (1974)  . 

24.  Tsiligiannis , C.  A.,  and  Svoronos,  S.  A.  Proc.  ACC, 

1309,  San  Diego,  California,  June  6-8  (1982)  . 

25.  Goodwin,  G.  C.,  and  Long,  R.  IEEE  Trans.  Aut.  Control, 

25,  1241  (1980).  

26.  Elliot,  H . , and  Wolowich,  W.  A.  IEEE  Trans.  Aut.  Con- 

trol, 27,  340  (1982) . 

27.  Johansson,  R.  IEEE  Proc.  Conf.  Dec.  and  Control,  3 q«q 

(1982).  — 

28.  Johansson,  R.  Ph.D.  Thesis.  Lund  Inst.  Technoloav 

(1983). 

29.  Pernebo,  L.  IEEE  Trans.  Aut.  Control,  26,  171  (1981). 

30.  Kaufmann,  A. , and  Labordere,  A.  H.  Integer  and  Mixed 

Programming,  Academic  Press,  New  York  (1977) . 

31.  Holt,  B.  R.,  and  Morari,  M.  Chem.  Eng.  Sci.,  40,  1229 

(1985)  . 2 — 

32.  Parks,  P.  C.  IEEE  Trans.  Aut.  Control,  11,  362  (1966). 

33.  Feuer,  A.,  and  Morse,  S.  IEEE  Trans.  Aut.  Control,  23, 

557  (1978).  — 

34.  Landau,  I.  D.  Adaptive  Control,  Marcel  Dekker , New 

York  (1979)T 

35.  Narendra,  K.  S.,  and  Lin,  Y.  H.  IEEE  Trans.  Aut.  Con- 

trol, 25,  456  (1980).  


102 


36.  Narendra,  K.  S.,  and  Valavani,  L.  S.  IEEE  Trans.  Aut 

Control,  23 , 570  (1978) . 

37.  Cordero,  A.  0.,  and  Mayne , D.  Q.  I EE  Proc.  Pt.  D,  128, 

19  (1981)  . 

38.  Ydstie,  E.,  and  Sargent,  R.  W . H.  6th  IFAC  Symp.  on 

Ident.  and  System  Parameter  Estimation,  Washing- 
ton, D.C.  (1982) . 

39.  Ljung,  L.  IEEE  Trans.  Aut.  Control,  22,  539  (1977). 

40.  Ljung,  L.  IEEE  Trans.  Aut.  Control,  22,  551  (1977). 

41.  Goodwin,  G.  C. , Ramadge,  P.  j. , and  Caines,  E.  P. 

SIAM  J.  Control  and  Optim.  , 19_,  829  (1981)  . 

42.  Sin,  K.  S.,  and  Goodwin,  G.  C.  Automatica,  18,  315 

(1982).  — 

43.  Landau,  I.  D.  Int.  J.  Control,  35 , 197  (1982). 

44.  Goodwin,  G.  C.,  and  Sin,  K.  S.  IEEE  Trans.  Aut.  Con- 

trol, 2_6  , 478  (1981)  . 

45.  Elliot,  H.,  Wolowich,  W.  A.,  and  Das,  M.  IEEE  Trans. 

Aut.  Control,  29_,  221  (1984)  . 

46.  Clarke,  P.  W.,  and  Gawthrop,  P.  J.  IEE  Proc.  Pt  D 

126,  633  (1979).  : ' 

47.  Kumar,  R. , and  Moore,  J.  B.  Automatica , 18,  449  (1983). 

48.  Gawthrop,  P.  j.  Int.  J.  Control,  31,  973  (1980). 

49.  Gawthrop,  P.  j.  IEE  Series,  15,  Edited  by  C.  J. 

Harris  and  S.  A.  Billings,  36  (1981) . 

50.  Ydstie,  E.,  and  Liu,  L.  K.  Presented  at  Am.  Contr. 

Conf . , San  Diego,  California,  June  6-8  (1984) . 

51.  Samson,  C.  These  de  Docteur  Ingenieur,  Universite  de 

Rennes  (1980) . 

52.  Lozano-Leal,  R. , and  Goodwin,  G.  C.  IEEE  Trans.  Aut 

Control,  30,  795  (1985) . 

53.  Peltomaa , A.,  and  Koivo,  H.  N.  Int.  J.  Control,  38, 

735  (1983)  . — 

54.  Gohberg, I.,  Lancaster,  P.,  and  Rodman,  L.  Matrix. 

Polynomials,  Academic  Press,  New  York  (1982) . 


103 


55. 

Tsiligiannis , C.  A.,  and 
In  Press. 

Svoronos,  S 

56. 

Gantmacher,  F.  R.  Theory 

of  Matrices 

Publishing  Co.,  New 

York  (1959). 

57. 

Kershenbaum,  L.  S.,  and 
Meeting,  Paper  578, 

Ydstie,  B.  E 
New  Orleans, 

• 

00 

in 

Fortescue,  T.  R. , Kershenbaum,  L.  S. 
Automatica,  14,  525  (1981). 

A.  Automatica 

Vol.  1,  Chelsea 

AIChE  Annual 
Louisiana  (1981) . 

and  Ydstie,  B.  F. 


BIOGRAPHICAL  SKETCH 


Christos  Tsiligiannis  was  born  on  August  2,  1958,  as  the 
first  child  of  Aristides  and  Irene  on  the  island  of  Lefkada, 
Greece.  He  received  his  earliest  education  in  Lefkada.  From 
1974  to  1976,  he  attended  the  second  Lyceum  of  Athens,  Greece. 
Upon  graduation,  he  passed  the  nationally  administered  aca- 
demic examinations  and  was  admitted  to  the  School  of  chemical 
engineering  at  the  National  Technical  University  of  Athens. 

He  graduated  from  N.  T.  U.  in  October,  1981,  and  began  his 
graduate  studies  at  the  University  of  Florida  in  January, 

19o2.  He  received  his  Master  of  Science  degree  in  chemical 
engineering  from  the  University  of  Florida  in  December,  1982. 
In  August,  1985,  he  was  awarded  the  Master  of  Science  degree 
in  applied  mathematics  from  the  University  of  Florida. 


104 


I certify  that  I have  read  this  study  and  that  in  my 
opinion  it  conforms  to  acceptable  standards  of  scholarly 
presentation  and  is  fully  adequate,  in  scope  and  quality, 
as  a dissertation  for  the  degree  of  Doctor  of  Philosophy. 


Dr.  L.  E.  Johns,  cnairman 
Professor  of  Chemical 
Engineering 


I certify  that  I have  read  this  study  and  that  in  my 
opinion  it  conforms  to  acceptable  standards  of  scholarly 
presentation  and  is  fully  adequate,  in  scope  and  quality, 
as  a dissertation  for  the  degree  of  Doctor  of  Philosophy. 


O A.  \ i 

Dr.  S.  A.  Svoronos  , Cochairman 
Assistant  Professor  of  Chemical 
Engineering 


I certify  that  I have  read  this  study  and  that  in  my 
opinion  it  conforms  to  acceptable  standards  of  scholarly 
presentation  and  is  fully  adequate,  in  scope  and  quality, 
as  a dissertation  for  the  degree  of  Doctor  of  Philosophy. 


via 

Dr . Eh  W.  Kamen 
Professor  of  Electrical 
Engineering 


I certify  that  I have  read  this  study  and  that  in  my 
opinion  it  conforms  to  acceptable  standards  of  scholarly 
presentation  and  is  fully  adequate,  in  scope  and  quality, 
as  a dissertation  for  the  degree  of  Doctor  of  Philosophy. 


, certify  that  I have  read  this  study  and  that  in  my 
opinion  it  conforms  to  acceptable  standards  of  scholarly 
presentation  and  is  fully  adequate,  in  scope  and  quality, 
as  a dissertation  for  the  degree  of  Doctor  of  Philosophy. 


This  dissertation  was  submitted  to  the  Graduate  Faculty  of 
the  College  of  Engineering  and  to  the  Graduate  School  and 
was  accepted  as  partial  fulfillment  of  the  requirements  for 
the  degree  of  Doctor  of  Philosophy. 

December,  1986 


Dr.  H. 

Professor  of  Chemical 


Engineering 


Dr.  G.  Lyberatos 

Assistant  Professor  of  Chemical 


Engineering 


Dean,  Graduate  School 


